Nov 15 11:05:09 user nova-compute[76049]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=76049) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=76049) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=76049) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 11:05:09 user nova-compute[76049]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:05:09 user nova-compute[76049]: INFO nova.virt.driver [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 11:05:09 user nova-compute[76049]: INFO nova.compute.provider_config [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Acquiring lock "singleton_lock" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Acquired lock "singleton_lock" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Releasing lock "singleton_lock" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Full set of CONF: {{(pid=76049) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ******************************************************************************** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Configuration options gathered from: {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ================================================================================ {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] allow_resize_to_same_host      = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] arq_binding_timeout            = 300 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] backdoor_port                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] backdoor_socket                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] block_device_allocate_retries  = 300 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] block_device_allocate_retries_interval = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cert                           = self.pem {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute_monitors               = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] config_dir                     = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] config_drive_format            = iso9660 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] config_source                  = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] console_host                   = user {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] control_exchange               = nova {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cpu_allocation_ratio           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] daemon                         = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] debug                          = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] default_access_ip_network_name = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] default_availability_zone      = nova {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] default_ephemeral_format       = ext4 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] default_green_pool_size        = 1000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] default_schedule_zone          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] disk_allocation_ratio          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] enable_new_services            = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] enabled_ssl_apis               = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] flat_injected                  = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] force_config_drive             = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] force_raw_images               = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] graceful_shutdown_timeout      = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] heal_instance_info_cache_interval = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] host                           = user {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instance_build_timeout         = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instance_delete_interval       = 300 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instance_name_template         = instance-%08x {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instance_usage_audit           = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instance_usage_audit_period    = month {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] internal_service_availability_zone = internal {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] key                            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] live_migration_retry_count     = 30 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_config_append              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_dir                        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_file                       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_options                    = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_rotate_interval            = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_rotate_interval_type       = days {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] log_rotation_type              = none {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] long_rpc_timeout               = 1800 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] max_concurrent_builds          = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] max_concurrent_live_migrations = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] max_concurrent_snapshots       = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] max_local_block_devices        = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] max_logfile_count              = 30 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] max_logfile_size_mb            = 200 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] maximum_instance_delete_attempts = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] metadata_listen                = 0.0.0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] metadata_listen_port           = 8775 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] metadata_workers               = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] migrate_max_retries            = -1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] mkisofs_cmd                    = genisoimage {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] my_ip                          = 10.0.0.210 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] network_allocate_retries       = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] osapi_compute_listen_port      = 8774 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] osapi_compute_unique_server_name_scope =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] osapi_compute_workers          = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] password_length                = 12 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] periodic_enable                = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] periodic_fuzzy_delay           = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] pointer_model                  = ps2mouse {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] preallocate_images             = none {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] publish_errors                 = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] pybasedir                      = /opt/stack/nova {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ram_allocation_ratio           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rate_limit_burst               = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rate_limit_except_level        = CRITICAL {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rate_limit_interval            = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] reboot_timeout                 = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] reclaim_instance_interval      = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] record                         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] reimage_timeout_per_gb         = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] report_interval                = 120 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rescue_timeout                 = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] reserved_host_cpus             = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] reserved_host_disk_mb          = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] reserved_host_memory_mb        = 512 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] reserved_huge_pages            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] resize_confirm_window          = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] resize_fs_using_block_device   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] resume_guests_state_on_host_boot = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rpc_response_timeout           = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] run_external_periodic_tasks    = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] running_deleted_instance_action = reap {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] running_deleted_instance_timeout = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler_instance_sync_interval = 120 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_down_time              = 720 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] servicegroup_driver            = db {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] shelved_offload_time           = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] shelved_poll_interval          = 3600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] shutdown_timeout               = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] source_is_ipv6                 = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ssl_only                       = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] state_path                     = /opt/stack/data/nova {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] sync_power_state_interval      = 600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] sync_power_state_pool_size     = 1000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] syslog_log_facility            = LOG_USER {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] tempdir                        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] timeout_nbd                    = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] transport_url                  = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] update_resources_interval      = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] use_cow_images                 = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] use_eventlog                   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] use_journal                    = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] use_json                       = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] use_rootwrap_daemon            = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] use_stderr                     = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] use_syslog                     = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vcpu_pin_set                   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plugging_is_fatal          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plugging_timeout           = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] virt_mkfs                      = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] volume_usage_poll_interval     = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] watch_log_file                 = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] web                            = /usr/share/spice-html5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_concurrency.disable_process_locking = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.auth_strategy              = keystone {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.compute_link_prefix        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.dhcp_domain                = novalocal {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.enable_instance_password   = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.glance_link_prefix         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.instance_list_per_project_cells = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.list_records_by_skipping_down_cells = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.local_metadata_per_cell    = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.max_limit                  = 1000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.metadata_cache_expiration  = 15 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.neutron_default_tenant_id  = default {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.use_forwarded_for          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.use_neutron_default_nets   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.vendordata_dynamic_targets = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.vendordata_jsonfile_path   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.backend_argument         = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.config_prefix            = cache.oslo {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.dead_timeout             = 60.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.debug_cache_backend      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.enable_retry_client      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.enable_socket_keepalive  = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.enabled                  = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.expiration_time          = 600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.hashclient_retry_attempts = 2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_dead_retry      = 300 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_password        =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_sasl_enabled    = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.memcache_username        =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.proxies                  = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.retry_attempts           = 2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.retry_delay              = 0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.socket_keepalive_count   = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.socket_keepalive_idle    = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.socket_keepalive_interval = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.tls_allowed_ciphers      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.tls_cafile               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.tls_certfile             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.tls_enabled              = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cache.tls_keyfile              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.auth_section            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.auth_type               = password {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.cafile                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.certfile                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.collect_timing          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.cross_az_attach         = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.debug                   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.endpoint_template       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.http_retries            = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.insecure                = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.keyfile                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.os_region_name          = RegionOne {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.split_loggers           = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cinder.timeout                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.cpu_dedicated_set      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.cpu_shared_set         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.image_type_exclude_list = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.resource_provider_association_refresh = 300 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.shutdown_retry_interval = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] conductor.workers              = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] console.allowed_origins        = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] console.ssl_ciphers            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] console.ssl_minimum_version    = default {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] consoleauth.token_ttl          = 600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.cafile                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.certfile                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.collect_timing          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.connect_retries         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.connect_retry_delay     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.endpoint_override       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.insecure                = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.keyfile                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.max_version             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.min_version             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.region_name             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.service_name            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.service_type            = accelerator {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.split_loggers           = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.status_code_retries     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.status_code_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.timeout                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] cyborg.version                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.backend               = sqlalchemy {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.connection            = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.connection_debug      = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.connection_parameters =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.connection_recycle_time = 3600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.connection_trace      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.db_inc_retry_interval = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.db_max_retries        = 20 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.db_max_retry_interval = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.db_retry_interval     = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.max_overflow          = 50 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.max_pool_size         = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.max_retries           = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.mysql_wsrep_sync_wait = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.pool_timeout          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.retry_interval        = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.slave_connection      = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] database.sqlite_synchronous    = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.backend           = sqlalchemy {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.connection        = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.connection_debug  = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.connection_parameters =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.connection_recycle_time = 3600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.connection_trace  = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.db_inc_retry_interval = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.db_max_retries    = 20 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.db_max_retry_interval = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.db_retry_interval = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.max_overflow      = 50 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.max_pool_size     = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.max_retries       = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.pool_timeout      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.retry_interval    = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.slave_connection  = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] api_database.sqlite_synchronous = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] devices.enabled_mdev_types     = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ephemeral_storage_encryption.enabled = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.api_servers             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.cafile                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.certfile                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.collect_timing          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.connect_retries         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.connect_retry_delay     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.debug                   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.default_trusted_certificate_ids = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.enable_certificate_validation = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.enable_rbd_download     = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.endpoint_override       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.insecure                = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.keyfile                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.max_version             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.min_version             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.num_retries             = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.rbd_ceph_conf           =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.rbd_connect_timeout     = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.rbd_pool                =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.rbd_user                =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.region_name             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.service_name            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.service_type            = image {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.split_loggers           = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.status_code_retries     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.status_code_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.timeout                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.verify_glance_signatures = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] glance.version                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] guestfs.debug                  = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.config_drive_cdrom      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.config_drive_inject_password = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.enable_remotefx         = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.instances_path_share    =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.limit_cpu_features      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.use_multipath_io        = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.vswitch_name            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] mks.enabled                    = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] image_cache.manager_interval   = 2400 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] image_cache.precache_concurrency = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] image_cache.remove_unused_base_images = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] image_cache.subdirectory_name  = _base {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.api_max_retries         = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.api_retry_interval      = 2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.auth_section            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.auth_type               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.cafile                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.certfile                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.collect_timing          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.conductor_group         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.connect_retries         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.connect_retry_delay     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.endpoint_override       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.insecure                = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.keyfile                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.max_version             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.min_version             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.peer_list               = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.region_name             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.serial_console_state_timeout = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.service_name            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.service_type            = baremetal {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.split_loggers           = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.status_code_retries     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.status_code_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.timeout                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ironic.version                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] key_manager.fixed_key          = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.barbican_api_version  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.barbican_endpoint     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.barbican_endpoint_type = public {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.barbican_region_name  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.cafile                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.certfile              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.collect_timing        = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.insecure              = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.keyfile               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.number_of_retries     = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.retry_delay           = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.send_service_user_token = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.split_loggers         = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.timeout               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.verify_ssl            = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican.verify_ssl_path       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.auth_section = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.auth_type = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.cafile   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.certfile = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.collect_timing = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.insecure = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.keyfile  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.split_loggers = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] barbican_service_user.timeout  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.approle_role_id          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.approle_secret_id        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.cafile                   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.certfile                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.collect_timing           = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.insecure                 = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.keyfile                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.kv_mountpoint            = secret {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.kv_path                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.kv_version               = 2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.namespace                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.root_token_id            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.split_loggers            = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.ssl_ca_crt_file          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.timeout                  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.use_ssl                  = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.auth_section          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.auth_type             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.cafile                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.certfile              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.collect_timing        = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.connect_retries       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.connect_retry_delay   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.endpoint_override     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.insecure              = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.keyfile               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.max_version           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.min_version           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.region_name           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.service_name          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.service_type          = identity {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.split_loggers         = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.status_code_retries   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.status_code_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.timeout               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] keystone.version               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.connection_uri         =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.cpu_mode               = custom {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: WARNING oslo_config.cfg [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.cpu_power_governor_high = performance {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.cpu_power_management   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.device_detach_attempts = 8 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.device_detach_timeout  = 20 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.disk_cachemodes        = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.disk_prefix            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.enabled_perf_events    = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.file_backed_memory     = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.gid_maps               = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.hw_disk_discard        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.hw_machine_type        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.images_rbd_pool        = rbd {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.images_type            = default {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.images_volume_group    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.inject_key             = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.inject_partition       = -2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.inject_password        = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.iscsi_iface            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.iser_use_multipath     = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_downtime = 500 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_inbound_addr = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_scheme  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_timeout_action = abort {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_tunnelled = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: WARNING oslo_config.cfg [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 11:05:09 user nova-compute[76049]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 11:05:09 user nova-compute[76049]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 11:05:09 user nova-compute[76049]: and ``live_migration_inbound_addr`` respectively.
Nov 15 11:05:09 user nova-compute[76049]: ).  Its value may be silently ignored in the future.
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.live_migration_with_native_tls = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.max_queues             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.nfs_mount_options      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.num_pcie_ports         = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.pmem_namespaces        = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.quobyte_client_cfg     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rbd_secret_uuid        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rbd_user               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rescue_image_id        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rescue_kernel_id       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.rx_queue_size          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.smbfs_mount_options    =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.snapshot_compression   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.snapshot_image_format  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.sparse_logical_volumes = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.swtpm_enabled          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.swtpm_group            = tss {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.swtpm_user             = tss {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.sysinfo_serial         = unique {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.tb_cache_size          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.tx_queue_size          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.uid_maps               = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.use_virtio_for_bridges = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.virt_type              = kvm {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.volume_clear           = zero {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.volume_clear_size      = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.volume_use_multipath   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.vzstorage_cache_path   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.auth_section           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.auth_type              = password {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.cafile                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.certfile               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.collect_timing         = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.connect_retries        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.connect_retry_delay    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.default_floating_pool  = public {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.endpoint_override      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.extension_sync_interval = 600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.http_retries           = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.insecure               = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.keyfile                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.max_version            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.min_version            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.ovs_bridge             = br-int {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.physnets               = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.region_name            = RegionOne {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.service_metadata_proxy = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.service_name           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.service_type           = network {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.split_loggers          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.status_code_retries    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.status_code_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.timeout                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] neutron.version                = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] notifications.bdms_in_notifications = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] notifications.default_level    = INFO {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] notifications.notification_format = unversioned {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] notifications.notify_on_state_change = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] pci.alias                      = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] pci.device_spec                = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] pci.report_in_placement        = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.auth_section         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.auth_type            = password {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.cafile               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.certfile             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.collect_timing       = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.connect_retries      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.connect_retry_delay  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.default_domain_id    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.default_domain_name  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.domain_id            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.domain_name          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.endpoint_override    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.insecure             = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.keyfile              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.max_version          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.min_version          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.password             = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.project_domain_id    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.project_domain_name  = Default {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.project_id           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.project_name         = service {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.region_name          = RegionOne {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.service_name         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.service_type         = placement {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.split_loggers        = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.status_code_retries  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.status_code_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.system_scope         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.timeout              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.trust_id             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.user_domain_id       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.user_domain_name     = Default {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.user_id              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.username             = placement {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] placement.version              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.cores                    = 20 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.count_usage_from_placement = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.injected_file_content_bytes = 10240 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.injected_file_path_length = 255 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.injected_files           = 5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.instances                = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.key_pairs                = 100 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.metadata_items           = 128 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.ram                      = 51200 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.recheck_quota            = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.server_group_members     = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] quota.server_groups            = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rdp.enabled                    = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.image_metadata_prefilter = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.max_attempts         = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.max_placement_results = 1000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] scheduler.workers              = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.host_subset_size = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:09 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.isolated_hosts = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.isolated_images = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.pci_in_placement = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.track_instance_changes = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] metrics.required               = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] metrics.weight_multiplier      = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] metrics.weight_setting         = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] serial_console.enabled         = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] serial_console.port_range      = 10000:20000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] serial_console.serialproxy_port = 6083 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.auth_section      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.auth_type         = password {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.cafile            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.certfile          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.collect_timing    = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.insecure          = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.keyfile           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.send_service_user_token = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.split_loggers     = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] service_user.timeout           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.agent_enabled            = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.enabled                  = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.html5proxy_port          = 6082 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.image_compression        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.jpeg_compression         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.playback_compression     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.server_listen            = 127.0.0.1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.streaming_mode           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] spice.zlib_compression         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] upgrade_levels.baseapi         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] upgrade_levels.cert            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] upgrade_levels.compute         = auto {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] upgrade_levels.conductor       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] upgrade_levels.scheduler       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.cafile = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.certfile = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.insecure = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vendordata_dynamic_auth.timeout = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.api_retry_count         = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.ca_file                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.cache_prefix            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.cluster_name            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.connection_pool_size    = 10 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.console_delay_seconds   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.datastore_regex         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.host_ip                 = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.host_password           = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.host_port               = 443 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.host_username           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.insecure                = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.integration_bridge      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.maximum_objects         = 100 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.pbm_default_policy      = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.pbm_enabled             = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.pbm_wsdl_location       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.serial_port_proxy_uri   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.serial_port_service_uri = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.task_poll_interval      = 0.5 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.use_linked_clone        = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.vnc_keymap              = en-us {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.vnc_port                = 5900 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vmware.vnc_port_total          = 10000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.auth_schemes               = ['none'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.enabled                    = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.novncproxy_port            = 6080 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.vencrypt_ca_certs          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.vencrypt_client_cert       = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vnc.vencrypt_client_key        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.disable_rootwrap   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.enable_numa_live_migration = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.libvirt_disable_apic = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.client_socket_timeout     = 900 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.default_pool_size         = 1000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.keep_alive                = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.max_header_line           = 16384 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.ssl_ca_file               = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.ssl_cert_file             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.ssl_key_file              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.tcp_keepidle              = 600 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] zvm.ca_file                    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] zvm.cloud_connector_url        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] zvm.reachable_timeout          = 300 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.enforce_new_defaults = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.enforce_scope      = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.policy_default_rule = default {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.connection_string     = messaging:// {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.enabled               = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.es_doc_type           = notification {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.es_scroll_size        = 10000 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.es_scroll_time        = 2m {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.filter_error_trace    = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.hmac_keys             = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.sentinel_service_name = mymaster {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.socket_timeout        = 0.1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.trace_requests        = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler.trace_sqlalchemy      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler_jaeger.process_tags   = {} {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler_jaeger.service_name_prefix = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] profiler_otlp.service_name_prefix = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] remote_debug.host              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] remote_debug.port              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_notifications.retry = -1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.auth_section        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.auth_type           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.cafile              = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.certfile            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.collect_timing      = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.connect_retries     = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.connect_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.endpoint_id         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.endpoint_override   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.insecure            = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.keyfile             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.max_version         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.min_version         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.region_name         = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.service_name        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.service_type        = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.split_loggers       = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.status_code_retries = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.status_code_retry_delay = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.timeout             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.valid_interfaces    = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_limit.version             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_reports.file_event_handler = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] oslo_reports.log_dir           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_ovs_privileged.group  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] vif_plug_ovs_privileged.user   = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_ovs.isolate_vif         = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] os_brick.lock_path             = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] privsep_osbrick.capabilities   = [21] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] privsep_osbrick.group          = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] privsep_osbrick.helper_command = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] privsep_osbrick.user           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] nova_sys_admin.group           = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] nova_sys_admin.helper_command  = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] nova_sys_admin.user            = None {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG oslo_service.service [None req-558e5e82-04a4-491f-90bf-4591a657f8a9 None None] ******************************************************************************** {{(pid=76049) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 11:05:10 user nova-compute[76049]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 11:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Connecting to libvirt: qemu:///system {{(pid=76049) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f629c2e70a0> {{(pid=76049) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 11:05:10 user nova-compute[76049]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 11:05:10 user nova-compute[76049]: WARNING nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 11:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f629c2e70a0> {{(pid=76049) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Starting native event thread {{(pid=76049) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Starting green dispatch thread {{(pid=76049) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 11:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Starting connection event dispatch thread {{(pid=76049) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 11:05:10 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Connection event '1' reason 'None'
Nov 15 11:05:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 11:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.mount [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Initialising _HostMountState generation 0 {{(pid=76049) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 11:05:17 user nova-compute[76049]: INFO nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host capabilities <capabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <host>
Nov 15 11:05:17 user nova-compute[76049]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 11:05:17 user nova-compute[76049]:     <cpu>
Nov 15 11:05:17 user nova-compute[76049]:       <arch>x86_64</arch>
Nov 15 11:05:17 user nova-compute[76049]:       <model>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <microcode version='1070'/>
Nov 15 11:05:17 user nova-compute[76049]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 11:05:17 user nova-compute[76049]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='osxsave'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='invtsc'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='rsba'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 11:05:17 user nova-compute[76049]:       <pages unit='KiB' size='4'/>
Nov 15 11:05:17 user nova-compute[76049]:       <pages unit='KiB' size='2048'/>
Nov 15 11:05:17 user nova-compute[76049]:     </cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <power_management>
Nov 15 11:05:17 user nova-compute[76049]:       <suspend_mem/>
Nov 15 11:05:17 user nova-compute[76049]:       <suspend_disk/>
Nov 15 11:05:17 user nova-compute[76049]:       <suspend_hybrid/>
Nov 15 11:05:17 user nova-compute[76049]:     </power_management>
Nov 15 11:05:17 user nova-compute[76049]:     <iommu support='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <migration_features>
Nov 15 11:05:17 user nova-compute[76049]:       <live/>
Nov 15 11:05:17 user nova-compute[76049]:       <uri_transports>
Nov 15 11:05:17 user nova-compute[76049]:         <uri_transport>tcp</uri_transport>
Nov 15 11:05:17 user nova-compute[76049]:         <uri_transport>rdma</uri_transport>
Nov 15 11:05:17 user nova-compute[76049]:       </uri_transports>
Nov 15 11:05:17 user nova-compute[76049]:     </migration_features>
Nov 15 11:05:17 user nova-compute[76049]:     <topology>
Nov 15 11:05:17 user nova-compute[76049]:       <cells num='2'>
Nov 15 11:05:17 user nova-compute[76049]:         <cell id='0'>
Nov 15 11:05:17 user nova-compute[76049]:           <memory unit='KiB'>8140616</memory>
Nov 15 11:05:17 user nova-compute[76049]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 15 11:05:17 user nova-compute[76049]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 11:05:17 user nova-compute[76049]:           <distances>
Nov 15 11:05:17 user nova-compute[76049]:             <sibling id='0' value='10'/>
Nov 15 11:05:17 user nova-compute[76049]:             <sibling id='1' value='20'/>
Nov 15 11:05:17 user nova-compute[76049]:           </distances>
Nov 15 11:05:17 user nova-compute[76049]:           <cpus num='6'>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 11:05:17 user nova-compute[76049]:           </cpus>
Nov 15 11:05:17 user nova-compute[76049]:         </cell>
Nov 15 11:05:17 user nova-compute[76049]:         <cell id='1'>
Nov 15 11:05:17 user nova-compute[76049]:           <memory unit='KiB'>8255068</memory>
Nov 15 11:05:17 user nova-compute[76049]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 15 11:05:17 user nova-compute[76049]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 11:05:17 user nova-compute[76049]:           <distances>
Nov 15 11:05:17 user nova-compute[76049]:             <sibling id='0' value='20'/>
Nov 15 11:05:17 user nova-compute[76049]:             <sibling id='1' value='10'/>
Nov 15 11:05:17 user nova-compute[76049]:           </distances>
Nov 15 11:05:17 user nova-compute[76049]:           <cpus num='6'>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 11:05:17 user nova-compute[76049]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 11:05:17 user nova-compute[76049]:           </cpus>
Nov 15 11:05:17 user nova-compute[76049]:         </cell>
Nov 15 11:05:17 user nova-compute[76049]:       </cells>
Nov 15 11:05:17 user nova-compute[76049]:     </topology>
Nov 15 11:05:17 user nova-compute[76049]:     <cache>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 11:05:17 user nova-compute[76049]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 11:05:17 user nova-compute[76049]:     </cache>
Nov 15 11:05:17 user nova-compute[76049]:     <secmodel>
Nov 15 11:05:17 user nova-compute[76049]:       <model>apparmor</model>
Nov 15 11:05:17 user nova-compute[76049]:       <doi>0</doi>
Nov 15 11:05:17 user nova-compute[76049]:     </secmodel>
Nov 15 11:05:17 user nova-compute[76049]:     <secmodel>
Nov 15 11:05:17 user nova-compute[76049]:       <model>dac</model>
Nov 15 11:05:17 user nova-compute[76049]:       <doi>0</doi>
Nov 15 11:05:17 user nova-compute[76049]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 11:05:17 user nova-compute[76049]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 11:05:17 user nova-compute[76049]:     </secmodel>
Nov 15 11:05:17 user nova-compute[76049]:   </host>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='alpha'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>clipper</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='armv6l'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>spitz</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>nuri</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>kzm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sx1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>z2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>tosa</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>n810</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>n800</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>terrier</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>midway</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>microbit</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>verdex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>highbank</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>akita</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>connex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>collie</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='armv7l'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>spitz</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>nuri</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>kzm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sx1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>z2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>tosa</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>n810</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>n800</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>terrier</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>midway</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>microbit</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>verdex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>highbank</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>akita</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>connex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>collie</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='aarch64'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>spitz</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>nuri</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>kzm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sx1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>z2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>tosa</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>n810</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>n800</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>terrier</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>midway</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>microbit</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>verdex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>highbank</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>akita</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>connex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>collie</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <acpi default='on' toggle='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='cris'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='i686'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>isapc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>microvm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='kvm'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <pae/>
Nov 15 11:05:17 user nova-compute[76049]:       <nonpae/>
Nov 15 11:05:17 user nova-compute[76049]:       <acpi default='on' toggle='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:       <apic default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='m68k'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>an5206</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>q800</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='microblaze'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='microblazeel'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='mips'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='16'>malta</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='mipsel'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='16'>malta</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='mips64'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='16'>malta</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>pica61</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>magnum</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='mips64el'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='16'>malta</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>pica61</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>magnum</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='16'>boston</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='ppc'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mac99</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>40p</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>taihu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='ppc64'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>taihu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>40p</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mac99</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='ppc64le'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>taihu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>40p</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>mac99</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='riscv32'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='8'>spike</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='8'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='riscv64'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='8'>spike</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='8'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='s390x'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='sh4'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>shix</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>r2d</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='sh4eb'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>shix</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>r2d</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='sparc'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>LX</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='sparc64'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>niagara</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='x86_64'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>64</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='1'>isapc</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>microvm</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='kvm'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <acpi default='on' toggle='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:       <apic default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='xtensa'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>sim</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>kc705</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>ml605</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx200</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx60</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]:   <guest>
Nov 15 11:05:17 user nova-compute[76049]:     <os_type>hvm</os_type>
Nov 15 11:05:17 user nova-compute[76049]:     <arch name='xtensaeb'>
Nov 15 11:05:17 user nova-compute[76049]:       <wordsize>32</wordsize>
Nov 15 11:05:17 user nova-compute[76049]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='4'>sim</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>kc705</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>ml605</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>virt</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx200</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>lx60</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 11:05:17 user nova-compute[76049]:       <domain type='qemu'/>
Nov 15 11:05:17 user nova-compute[76049]:     </arch>
Nov 15 11:05:17 user nova-compute[76049]:     <features>
Nov 15 11:05:17 user nova-compute[76049]:       <cpuselection/>
Nov 15 11:05:17 user nova-compute[76049]:       <deviceboot/>
Nov 15 11:05:17 user nova-compute[76049]:       <disksnapshot default='on' toggle='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     </features>
Nov 15 11:05:17 user nova-compute[76049]:   </guest>
Nov 15 11:05:17 user nova-compute[76049]: </capabilities>
Nov 15 11:05:17 user nova-compute[76049]: 
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-i440fx-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>i686</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='255'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'/>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='lm'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ide</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-q35-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>i686</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='288'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'/>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='lm'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-i440fx-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>i686</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='255'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'/>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='lm'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ide</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-q35-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>i686</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='288'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'/>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='lm'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-i440fx-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>x86_64</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='255'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>efi</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='invtsc'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='rsba'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ide</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-q35-6.2</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>x86_64</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='288'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>efi</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='invtsc'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='rsba'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-i440fx-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>x86_64</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='255'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>efi</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='invtsc'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='rsba'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ide</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 11:05:17 user nova-compute[76049]: <domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 11:05:17 user nova-compute[76049]:   <domain>kvm</domain>
Nov 15 11:05:17 user nova-compute[76049]:   <machine>pc-q35-jammy</machine>
Nov 15 11:05:17 user nova-compute[76049]:   <arch>x86_64</arch>
Nov 15 11:05:17 user nova-compute[76049]:   <vcpu max='288'/>
Nov 15 11:05:17 user nova-compute[76049]:   <iothreads supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:   <os supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='firmware'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>efi</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:     <loader supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>rom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pflash</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='readonly'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='secure'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>yes</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>no</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </loader>
Nov 15 11:05:17 user nova-compute[76049]:   </os>
Nov 15 11:05:17 user nova-compute[76049]:   <cpu>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-passthrough' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='hostPassthroughMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='maximum' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='maximumMigratable'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>on</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>off</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='host-model' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <vendor>Intel</vendor>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ss'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='vmx'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pcid'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='hypervisor'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arat'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='umip'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='md-clear'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='invtsc'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibpb'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='ibrs'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-stibp'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='rsba'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='erms'/>
Nov 15 11:05:17 user nova-compute[76049]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:     <mode name='custom' supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>qemu64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>qemu32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>phenom</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>pentium</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>n270</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm64</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>kvm32</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>coreduo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>core2duo</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>athlon</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Westmere</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Snowridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Skylake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>SandyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Penryn</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G5</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G4</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G3</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Opteron_G2</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Opteron_G1</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>IvyBridge</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Icelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Haswell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Rome</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-Milan</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>EPYC</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Dhyana</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cooperlake</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>Conroe</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='no'>Broadwell</model>
Nov 15 11:05:17 user nova-compute[76049]:       <model usable='yes'>486</model>
Nov 15 11:05:17 user nova-compute[76049]:     </mode>
Nov 15 11:05:17 user nova-compute[76049]:   </cpu>
Nov 15 11:05:17 user nova-compute[76049]:   <memoryBacking supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:     <enum name='sourceType'>
Nov 15 11:05:17 user nova-compute[76049]:       <value>file</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>anonymous</value>
Nov 15 11:05:17 user nova-compute[76049]:       <value>memfd</value>
Nov 15 11:05:17 user nova-compute[76049]:     </enum>
Nov 15 11:05:17 user nova-compute[76049]:   </memoryBacking>
Nov 15 11:05:17 user nova-compute[76049]:   <devices>
Nov 15 11:05:17 user nova-compute[76049]:     <disk supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='diskDevice'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>disk</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cdrom</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>floppy</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>lun</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='bus'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>fdc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sata</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </disk>
Nov 15 11:05:17 user nova-compute[76049]:     <graphics supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='type'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>sdl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vnc</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>spice</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egl-headless</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </graphics>
Nov 15 11:05:17 user nova-compute[76049]:     <video supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='modelType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>cirrus</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>vmvga</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>qxl</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>none</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>bochs</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>ramfb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </video>
Nov 15 11:05:17 user nova-compute[76049]:     <hostdev supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='mode'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>subsystem</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='startupPolicy'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>default</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>mandatory</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>requisite</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>optional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='subsysType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>usb</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>pci</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>scsi</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='capsType'/>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='pciBackend'/>
Nov 15 11:05:17 user nova-compute[76049]:     </hostdev>
Nov 15 11:05:17 user nova-compute[76049]:     <rng supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtio-non-transitional</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>random</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>egd</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>builtin</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </rng>
Nov 15 11:05:17 user nova-compute[76049]:     <filesystem supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='driverType'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>path</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>handle</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>virtiofs</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </filesystem>
Nov 15 11:05:17 user nova-compute[76049]:     <tpm supported='yes'>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='model'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-tis</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>tpm-crb</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:       <enum name='backendModel'>
Nov 15 11:05:17 user nova-compute[76049]:         <value>passthrough</value>
Nov 15 11:05:17 user nova-compute[76049]:         <value>emulator</value>
Nov 15 11:05:17 user nova-compute[76049]:       </enum>
Nov 15 11:05:17 user nova-compute[76049]:     </tpm>
Nov 15 11:05:17 user nova-compute[76049]:   </devices>
Nov 15 11:05:17 user nova-compute[76049]:   <features>
Nov 15 11:05:17 user nova-compute[76049]:     <gic supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:     <vmcoreinfo supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <genid supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backingStoreInput supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <backup supported='yes'/>
Nov 15 11:05:17 user nova-compute[76049]:     <sev supported='no'/>
Nov 15 11:05:17 user nova-compute[76049]:   </features>
Nov 15 11:05:17 user nova-compute[76049]: </domainCapabilities>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=76049) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=76049) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Checking secure boot support for host arch (x86_64) {{(pid=76049) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Checking secure boot support for host arch (x86_64) {{(pid=76049) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Checking secure boot support for host arch (x86_64) {{(pid=76049) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 11:05:17 user nova-compute[76049]: INFO nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Secure Boot support detected
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] cpu compare xml: <cpu match="exact">
Nov 15 11:05:17 user nova-compute[76049]:   <model>Nehalem</model>
Nov 15 11:05:17 user nova-compute[76049]: </cpu>
Nov 15 11:05:17 user nova-compute[76049]:  {{(pid=76049) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 11:05:17 user nova-compute[76049]: INFO nova.virt.node [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Generated node identity 260aaae9-3cc3-45eb-be88-21bcfcddde10
Nov 15 11:05:17 user nova-compute[76049]: INFO nova.virt.node [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Wrote node identity 260aaae9-3cc3-45eb-be88-21bcfcddde10 to /opt/stack/data/nova/compute_id
Nov 15 11:05:17 user nova-compute[76049]: WARNING nova.compute.manager [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Compute nodes ['260aaae9-3cc3-45eb-be88-21bcfcddde10'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 11:05:17 user nova-compute[76049]: INFO nova.compute.manager [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 11:05:17 user nova-compute[76049]: WARNING nova.compute.manager [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 11:05:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:05:17 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:05:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:05:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Hypervisor/Node resource view: name=user free_ram=10998MB free_disk=26.25772476196289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:05:18 user nova-compute[76049]: WARNING nova.compute.resource_tracker [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] No compute node record for user:260aaae9-3cc3-45eb-be88-21bcfcddde10: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 260aaae9-3cc3-45eb-be88-21bcfcddde10 could not be found.
Nov 15 11:05:18 user nova-compute[76049]: INFO nova.compute.resource_tracker [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Compute node record created for user:user with uuid: 260aaae9-3cc3-45eb-be88-21bcfcddde10
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:05:18 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] [req-7f100ffe-742f-46bd-a1d1-224c92e61aee] Created resource provider record via placement API for resource provider with UUID 260aaae9-3cc3-45eb-be88-21bcfcddde10 and name user.
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=76049) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 11:05:18 user nova-compute[76049]: INFO nova.virt.libvirt.host [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] kernel doesn't support AMD SEV
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Libvirt baseline CPU <cpu>
Nov 15 11:05:18 user nova-compute[76049]:   <arch>x86_64</arch>
Nov 15 11:05:18 user nova-compute[76049]:   <model>Nehalem</model>
Nov 15 11:05:18 user nova-compute[76049]:   <vendor>Intel</vendor>
Nov 15 11:05:18 user nova-compute[76049]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 11:05:18 user nova-compute[76049]: </cpu>
Nov 15 11:05:18 user nova-compute[76049]:  {{(pid=76049) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Updated inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Updating resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 generation from 0 to 1 during operation: update_inventory {{(pid=76049) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Updating resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 generation from 1 to 2 during operation: update_traits {{(pid=76049) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.service [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Creating RPC server for service compute {{(pid=76049) start /opt/stack/nova/nova/service.py:182}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.service [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] Join ServiceGroup membership for this service compute {{(pid=76049) start /opt/stack/nova/nova/service.py:199}}
Nov 15 11:05:18 user nova-compute[76049]: DEBUG nova.servicegroup.drivers.db [None req-cb80d0d3-0074-42e9-8fd4-bafbec76cb6d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=76049) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_power_states {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:06:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:06:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:06:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:06:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=10340MB free_disk=26.161563873291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:06:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:07:11 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:07:11 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:07:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=10338MB free_disk=26.2000732421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:07:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:08:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:08:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:08:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:08:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:08:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:08:13 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:08:13 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:08:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=10316MB free_disk=25.978195190429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:08:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:11 user nova-compute[76049]: INFO nova.compute.claims [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Claim successful on node user
Nov 15 11:09:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Creating image(s)
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "/opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "/opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "/opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:13 user nova-compute[76049]: DEBUG nova.policy [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '054f6d96df9a4df6aa4f5b00e6b1f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e28b05b2524b688c740523ac2e8e1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.part --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG nova.virt.images [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] 2b3c94d7-0d98-4e44-a0fb-491b41156c7f was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.part /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.part /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.converted" returned: 0 in 0.428s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc.converted --force-share --output=json" returned: 0 in 0.435s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.800s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:14 user nova-compute[76049]: INFO oslo.privsep.daemon [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpicjlr6lo/privsep.sock']
Nov 15 11:09:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:14 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9528MB free_disk=25.935997009277344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:14 user sudo[85312]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpicjlr6lo/privsep.sock
Nov 15 11:09:14 user sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 11:09:15 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4688fd69-68cc-4345-b191-9d92c2e9456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:09:15 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:09:15 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:09:15 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:15 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:15 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:09:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Successfully created port: cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:16 user sudo[85312]: pam_unix(sudo:session): session closed for user root
Nov 15 11:09:16 user nova-compute[76049]: INFO oslo.privsep.daemon [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Spawned new privsep daemon via rootwrap
Nov 15 11:09:16 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 11:09:16 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 11:09:16 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 11:09:16 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85324
Nov 15 11:09:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk 1073741824" returned: 0 in 0.045s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.217s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Cannot resize image /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Ensure instance console log exists: /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Successfully updated port: cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquired lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received event network-changed-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Refreshing instance network info cache due to event network-changed-cf5a643d-0107-4edd-ba4b-72058019a2e2. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:09:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] Acquiring lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updating instance_info_cache with network_info: [{"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Releasing lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Instance network_info: |[{"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] Acquired lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Refreshing network info cache for port cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Start _get_guest_xml network_info=[{"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:09:20 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:20 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-352509533',display_name='tempest-DeleteServersTestJSON-server-352509533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-352509533',id=1,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0e28b05b2524b688c740523ac2e8e1e',ramdisk_id='',reservation_id='r-v9pl1fpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-647641200',owner_user_name='tempest-DeleteServersTestJSON-647641200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:13Z,user_data=None,user_id='054f6d96df9a4df6aa4f5b00e6b1f56e',uuid=4688fd69-68cc-4345-b191-9d92c2e9456a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Converting VIF {"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:89:0e,bridge_name='br-int',has_traffic_filtering=True,id=cf5a643d-0107-4edd-ba4b-72058019a2e2,network=Network(81a5ed4b-d256-4852-9c17-e88c4b0dc87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a643d-01') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lazy-loading 'pci_devices' on Instance uuid 4688fd69-68cc-4345-b191-9d92c2e9456a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:09:20 user nova-compute[76049]:   <uuid>4688fd69-68cc-4345-b191-9d92c2e9456a</uuid>
Nov 15 11:09:20 user nova-compute[76049]:   <name>instance-00000001</name>
Nov 15 11:09:20 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:09:20 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:09:20 user nova-compute[76049]:   <metadata>
Nov 15 11:09:20 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:09:20 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:09:20 user nova-compute[76049]:       <nova:name>tempest-DeleteServersTestJSON-server-352509533</nova:name>
Nov 15 11:09:20 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:09:20</nova:creationTime>
Nov 15 11:09:20 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:09:20 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:09:20 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:09:20 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:09:20 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:09:20 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:09:20 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:09:20 user nova-compute[76049]:       <nova:owner>
Nov 15 11:09:20 user nova-compute[76049]:         <nova:user uuid="054f6d96df9a4df6aa4f5b00e6b1f56e">tempest-DeleteServersTestJSON-647641200-project-member</nova:user>
Nov 15 11:09:20 user nova-compute[76049]:         <nova:project uuid="b0e28b05b2524b688c740523ac2e8e1e">tempest-DeleteServersTestJSON-647641200</nova:project>
Nov 15 11:09:20 user nova-compute[76049]:       </nova:owner>
Nov 15 11:09:20 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:09:20 user nova-compute[76049]:       <nova:ports>
Nov 15 11:09:20 user nova-compute[76049]:         <nova:port uuid="cf5a643d-0107-4edd-ba4b-72058019a2e2">
Nov 15 11:09:20 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:09:20 user nova-compute[76049]:         </nova:port>
Nov 15 11:09:20 user nova-compute[76049]:       </nova:ports>
Nov 15 11:09:20 user nova-compute[76049]:     </nova:instance>
Nov 15 11:09:20 user nova-compute[76049]:   </metadata>
Nov 15 11:09:20 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:09:20 user nova-compute[76049]:     <system>
Nov 15 11:09:20 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:09:20 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:09:20 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:09:20 user nova-compute[76049]:       <entry name="serial">4688fd69-68cc-4345-b191-9d92c2e9456a</entry>
Nov 15 11:09:20 user nova-compute[76049]:       <entry name="uuid">4688fd69-68cc-4345-b191-9d92c2e9456a</entry>
Nov 15 11:09:20 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:09:20 user nova-compute[76049]:     </system>
Nov 15 11:09:20 user nova-compute[76049]:   </sysinfo>
Nov 15 11:09:20 user nova-compute[76049]:   <os>
Nov 15 11:09:20 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:09:20 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:09:20 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:09:20 user nova-compute[76049]:   </os>
Nov 15 11:09:20 user nova-compute[76049]:   <features>
Nov 15 11:09:20 user nova-compute[76049]:     <acpi/>
Nov 15 11:09:20 user nova-compute[76049]:     <apic/>
Nov 15 11:09:20 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:09:20 user nova-compute[76049]:   </features>
Nov 15 11:09:20 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:09:20 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:09:20 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:09:20 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:09:20 user nova-compute[76049]:   </clock>
Nov 15 11:09:20 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:09:20 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:09:20 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:09:20 user nova-compute[76049]:   </cpu>
Nov 15 11:09:20 user nova-compute[76049]:   <devices>
Nov 15 11:09:20 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:09:20 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:09:20 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk"/>
Nov 15 11:09:20 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:09:20 user nova-compute[76049]:     </disk>
Nov 15 11:09:20 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:09:20 user nova-compute[76049]:       <mac address="fa:16:3e:2d:89:0e"/>
Nov 15 11:09:20 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:20 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:09:20 user nova-compute[76049]:       <target dev="tapcf5a643d-01"/>
Nov 15 11:09:20 user nova-compute[76049]:     </interface>
Nov 15 11:09:20 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:09:20 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/console.log" append="off"/>
Nov 15 11:09:20 user nova-compute[76049]:     </serial>
Nov 15 11:09:20 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:09:20 user nova-compute[76049]:     <video>
Nov 15 11:09:20 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:20 user nova-compute[76049]:     </video>
Nov 15 11:09:20 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:09:20 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:09:20 user nova-compute[76049]:     </rng>
Nov 15 11:09:20 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:09:20 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:09:20 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:09:20 user nova-compute[76049]:     </memballoon>
Nov 15 11:09:20 user nova-compute[76049]:   </devices>
Nov 15 11:09:20 user nova-compute[76049]: </domain>
Nov 15 11:09:20 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-352509533',display_name='tempest-DeleteServersTestJSON-server-352509533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-352509533',id=1,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0e28b05b2524b688c740523ac2e8e1e',ramdisk_id='',reservation_id='r-v9pl1fpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-647641200',owner_user_name='tempest-DeleteServersTestJSON-647641200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:13Z,user_data=None,user_id='054f6d96df9a4df6aa4f5b00e6b1f56e',uuid=4688fd69-68cc-4345-b191-9d92c2e9456a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Converting VIF {"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:89:0e,bridge_name='br-int',has_traffic_filtering=True,id=cf5a643d-0107-4edd-ba4b-72058019a2e2,network=Network(81a5ed4b-d256-4852-9c17-e88c4b0dc87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a643d-01') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG os_vif [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:89:0e,bridge_name='br-int',has_traffic_filtering=True,id=cf5a643d-0107-4edd-ba4b-72058019a2e2,network=Network(81a5ed4b-d256-4852-9c17-e88c4b0dc87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a643d-01') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Created schema index Interface.name {{(pid=76049) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Created schema index Port.name {{(pid=76049) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Created schema index Bridge.name {{(pid=76049) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [POLLOUT] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '275de9e7-6424-5372-8ec3-3ddbb23ba10e', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:20 user nova-compute[76049]: INFO oslo.privsep.daemon [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpyzshnnuz/privsep.sock']
Nov 15 11:09:20 user sudo[85356]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpyzshnnuz/privsep.sock
Nov 15 11:09:20 user sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 11:09:21 user nova-compute[76049]: DEBUG nova.network.neutron [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updated VIF entry in instance network info cache for port cf5a643d-0107-4edd-ba4b-72058019a2e2. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:09:21 user nova-compute[76049]: DEBUG nova.network.neutron [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updating instance_info_cache with network_info: [{"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d9c3e7f7-fdcd-42e0-80a9-ff7c9a62523e req-02d6dd3b-953b-4b88-aff8-8e9bc8d24eee service nova] Releasing lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:22 user sudo[85356]: pam_unix(sudo:session): session closed for user root
Nov 15 11:09:22 user nova-compute[76049]: INFO oslo.privsep.daemon [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Spawned new privsep daemon via rootwrap
Nov 15 11:09:22 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 11:09:22 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 11:09:22 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 11:09:22 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85362
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf5a643d-01, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf5a643d-01, col_values=(('qos', UUID('2b0aa4a2-2424-437e-b7a7-519dc95ff393')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf5a643d-01, col_values=(('external_ids', {'iface-id': 'cf5a643d-0107-4edd-ba4b-72058019a2e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:89:0e', 'vm-uuid': '4688fd69-68cc-4345-b191-9d92c2e9456a'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:22 user nova-compute[76049]: INFO os_vif [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:89:0e,bridge_name='br-int',has_traffic_filtering=True,id=cf5a643d-0107-4edd-ba4b-72058019a2e2,network=Network(81a5ed4b-d256-4852-9c17-e88c4b0dc87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a643d-01')
Nov 15 11:09:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] No VIF found with MAC fa:16:3e:2d:89:0e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:23 user nova-compute[76049]: INFO nova.compute.claims [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Claim successful on node user
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Creating image(s)
Nov 15 11:09:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.165s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG nova.policy [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd3cb19baf044c1ca816581576c5c243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4977c566adae433e8780d44d86f18757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.210s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk 1073741824" returned: 0 in 0.053s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.214s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Cannot resize image /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Ensure instance console log exists: /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-1f4649e3-c24f-4d92-a931-8b288548b7ed req-45f185ac-b243-4d24-a21e-b851473aa19c service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received event network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1f4649e3-c24f-4d92-a931-8b288548b7ed req-45f185ac-b243-4d24-a21e-b851473aa19c service nova] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1f4649e3-c24f-4d92-a931-8b288548b7ed req-45f185ac-b243-4d24-a21e-b851473aa19c service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1f4649e3-c24f-4d92-a931-8b288548b7ed req-45f185ac-b243-4d24-a21e-b851473aa19c service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-1f4649e3-c24f-4d92-a931-8b288548b7ed req-45f185ac-b243-4d24-a21e-b851473aa19c service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] No waiting events found dispatching network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:09:25 user nova-compute[76049]: WARNING nova.compute.manager [req-1f4649e3-c24f-4d92-a931-8b288548b7ed req-45f185ac-b243-4d24-a21e-b851473aa19c service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received unexpected event network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 for instance with vm_state building and task_state spawning.
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.network.neutron [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Successfully created port: b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:09:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Instance spawned successfully.
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:26 user nova-compute[76049]: INFO nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Took 13.40 seconds to spawn the instance on the hypervisor.
Nov 15 11:09:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:09:26 user nova-compute[76049]: INFO nova.compute.manager [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Took 14.94 seconds to build instance.
Nov 15 11:09:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6f4e1ace-6be1-4020-84ad-f95fd53e42a2 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.211s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-9dc024d9-dd02-4f06-99cf-7e98d972a24e req-ee6a55f9-a204-48ba-b4a3-978cf4e2f8fe service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received event network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9dc024d9-dd02-4f06-99cf-7e98d972a24e req-ee6a55f9-a204-48ba-b4a3-978cf4e2f8fe service nova] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9dc024d9-dd02-4f06-99cf-7e98d972a24e req-ee6a55f9-a204-48ba-b4a3-978cf4e2f8fe service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9dc024d9-dd02-4f06-99cf-7e98d972a24e req-ee6a55f9-a204-48ba-b4a3-978cf4e2f8fe service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-9dc024d9-dd02-4f06-99cf-7e98d972a24e req-ee6a55f9-a204-48ba-b4a3-978cf4e2f8fe service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] No waiting events found dispatching network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:09:27 user nova-compute[76049]: WARNING nova.compute.manager [req-9dc024d9-dd02-4f06-99cf-7e98d972a24e req-ee6a55f9-a204-48ba-b4a3-978cf4e2f8fe service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received unexpected event network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 for instance with vm_state active and task_state None.
Nov 15 11:09:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Successfully updated port: b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing instance network info cache due to event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance network_info: |[{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Start _get_guest_xml network_info=[{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:09:29 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:29 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-393013812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-393013812',id=2,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8LEUVi10YoVRk8Bt3EmnWh9/k9X2INlqp/sb6d1S9EQYyuTkFw6kJNq6qzcERUuGw5MvT+duO6T6+Uq2l2vnP4xs4tbX3GSnkbIODd2HgeX3znRsIJo5AxpueBFN8D4Q==',key_name='tempest-keypair-1888008997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-q1vxyx50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=d23b5032-89df-47d6-93fa-496bd3d5671c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.objects.instance [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'pci_devices' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:09:29 user nova-compute[76049]:   <uuid>d23b5032-89df-47d6-93fa-496bd3d5671c</uuid>
Nov 15 11:09:29 user nova-compute[76049]:   <name>instance-00000002</name>
Nov 15 11:09:29 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:09:29 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:09:29 user nova-compute[76049]:   <metadata>
Nov 15 11:09:29 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:09:29 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:09:29 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-393013812</nova:name>
Nov 15 11:09:29 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:09:29</nova:creationTime>
Nov 15 11:09:29 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:09:29 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:09:29 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:09:29 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:09:29 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:09:29 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:09:29 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:09:29 user nova-compute[76049]:       <nova:owner>
Nov 15 11:09:29 user nova-compute[76049]:         <nova:user uuid="fd3cb19baf044c1ca816581576c5c243">tempest-AttachVolumeShelveTestJSON-10410443-project-member</nova:user>
Nov 15 11:09:29 user nova-compute[76049]:         <nova:project uuid="4977c566adae433e8780d44d86f18757">tempest-AttachVolumeShelveTestJSON-10410443</nova:project>
Nov 15 11:09:29 user nova-compute[76049]:       </nova:owner>
Nov 15 11:09:29 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:09:29 user nova-compute[76049]:       <nova:ports>
Nov 15 11:09:29 user nova-compute[76049]:         <nova:port uuid="b1bdc1ea-ee41-4895-8cfd-47055753f58c">
Nov 15 11:09:29 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 11:09:29 user nova-compute[76049]:         </nova:port>
Nov 15 11:09:29 user nova-compute[76049]:       </nova:ports>
Nov 15 11:09:29 user nova-compute[76049]:     </nova:instance>
Nov 15 11:09:29 user nova-compute[76049]:   </metadata>
Nov 15 11:09:29 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:09:29 user nova-compute[76049]:     <system>
Nov 15 11:09:29 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:09:29 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:09:29 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:09:29 user nova-compute[76049]:       <entry name="serial">d23b5032-89df-47d6-93fa-496bd3d5671c</entry>
Nov 15 11:09:29 user nova-compute[76049]:       <entry name="uuid">d23b5032-89df-47d6-93fa-496bd3d5671c</entry>
Nov 15 11:09:29 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:09:29 user nova-compute[76049]:     </system>
Nov 15 11:09:29 user nova-compute[76049]:   </sysinfo>
Nov 15 11:09:29 user nova-compute[76049]:   <os>
Nov 15 11:09:29 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:09:29 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:09:29 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:09:29 user nova-compute[76049]:   </os>
Nov 15 11:09:29 user nova-compute[76049]:   <features>
Nov 15 11:09:29 user nova-compute[76049]:     <acpi/>
Nov 15 11:09:29 user nova-compute[76049]:     <apic/>
Nov 15 11:09:29 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:09:29 user nova-compute[76049]:   </features>
Nov 15 11:09:29 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:09:29 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:09:29 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:09:29 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:09:29 user nova-compute[76049]:   </clock>
Nov 15 11:09:29 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:09:29 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:09:29 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:09:29 user nova-compute[76049]:   </cpu>
Nov 15 11:09:29 user nova-compute[76049]:   <devices>
Nov 15 11:09:29 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:09:29 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:09:29 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk"/>
Nov 15 11:09:29 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:09:29 user nova-compute[76049]:     </disk>
Nov 15 11:09:29 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:09:29 user nova-compute[76049]:       <mac address="fa:16:3e:11:ea:7e"/>
Nov 15 11:09:29 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:29 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:09:29 user nova-compute[76049]:       <target dev="tapb1bdc1ea-ee"/>
Nov 15 11:09:29 user nova-compute[76049]:     </interface>
Nov 15 11:09:29 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:09:29 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/console.log" append="off"/>
Nov 15 11:09:29 user nova-compute[76049]:     </serial>
Nov 15 11:09:29 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:09:29 user nova-compute[76049]:     <video>
Nov 15 11:09:29 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:29 user nova-compute[76049]:     </video>
Nov 15 11:09:29 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:09:29 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:09:29 user nova-compute[76049]:     </rng>
Nov 15 11:09:29 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:09:29 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:09:29 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:09:29 user nova-compute[76049]:     </memballoon>
Nov 15 11:09:29 user nova-compute[76049]:   </devices>
Nov 15 11:09:29 user nova-compute[76049]: </domain>
Nov 15 11:09:29 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-393013812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-393013812',id=2,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8LEUVi10YoVRk8Bt3EmnWh9/k9X2INlqp/sb6d1S9EQYyuTkFw6kJNq6qzcERUuGw5MvT+duO6T6+Uq2l2vnP4xs4tbX3GSnkbIODd2HgeX3znRsIJo5AxpueBFN8D4Q==',key_name='tempest-keypair-1888008997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-q1vxyx50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=d23b5032-89df-47d6-93fa-496bd3d5671c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG os_vif [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a8e72c6-21c5-5997-afef-6a971265f68b', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1bdc1ea-ee, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1bdc1ea-ee, col_values=(('qos', UUID('56cc5f8b-97fb-4369-897e-0b865bc35def')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1bdc1ea-ee, col_values=(('external_ids', {'iface-id': 'b1bdc1ea-ee41-4895-8cfd-47055753f58c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:ea:7e', 'vm-uuid': 'd23b5032-89df-47d6-93fa-496bd3d5671c'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:29 user nova-compute[76049]: INFO os_vif [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee')
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No VIF found with MAC fa:16:3e:11:ea:7e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:09:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updated VIF entry in instance network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:09:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9701d3fd-a1ae-4731-8a78-e3e084019e53 req-87ceb8bd-938e-404c-b4d7-e920d42ea565 service nova] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:34 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance spawned successfully.
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:34 user nova-compute[76049]: INFO nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Took 10.51 seconds to spawn the instance on the hypervisor.
Nov 15 11:09:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:09:34 user nova-compute[76049]: INFO nova.compute.manager [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Took 11.40 seconds to build instance.
Nov 15 11:09:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33402e67-37f8-4e76-aa98-71f6989a59ca tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.539s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:37 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:37 user nova-compute[76049]: INFO nova.compute.claims [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Claim successful on node user
Nov 15 11:09:37 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:37 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG nova.policy [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '543673d5b4f241df830806894717043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b6dce9c3847f1be9a07015b683421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Creating image(s)
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "/opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "/opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.243s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk 1073741824" returned: 0 in 0.096s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.243s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:39 user nova-compute[76049]: INFO nova.compute.claims [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Claim successful on node user
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Cannot resize image /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Ensure instance console log exists: /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Successfully created port: 1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:40 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:40 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.381s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Creating image(s)
Nov 15 11:09:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "/opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "/opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "/opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "534cecf3f83905ddd67b1b9e45daf952c8704df3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "534cecf3f83905ddd67b1b9e45daf952c8704df3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG nova.policy [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '862bd9d989bc4ca586e0c65c4fdd7069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0e67b1b1604fd9b8a72b6e9f8f426e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.part --force-share --output=json" returned: 0 in 0.252s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.virt.images [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] 8e16a4a9-58c6-417f-943b-731a6dee758c was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.part /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:42 user nova-compute[76049]: INFO nova.compute.claims [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Claim successful on node user
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.part /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.converted" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.network.neutron [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Successfully updated port: 1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-changed-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Refreshing instance network info cache due to event network-changed-1aa140e7-30ef-4482-a23f-d95d0b2a9da9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] Acquiring lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] Acquired lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.network.neutron [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Refreshing network info cache for port 1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3.converted --force-share --output=json" returned: 0 in 0.276s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "534cecf3f83905ddd67b1b9e45daf952c8704df3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.396s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.network.neutron [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3 --force-share --output=json" returned: 0 in 0.240s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "534cecf3f83905ddd67b1b9e45daf952c8704df3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "534cecf3f83905ddd67b1b9e45daf952c8704df3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:42 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:43 user nova-compute[76049]: INFO nova.compute.claims [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Claim successful on node user
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3 --force-share --output=json" returned: 0 in 0.220s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3,backing_fmt=raw /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:43 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d345f6b8-05b1-443d-b9ea-74ecf8443d7a req-ebd9f185-38b0-47f5-84b1-fd57912294ed service nova] Releasing lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquired lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3,backing_fmt=raw /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk 1073741824" returned: 0 in 0.081s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "534cecf3f83905ddd67b1b9e45daf952c8704df3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.policy [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e5ae3fcc46c4fd1834660eb48910332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554876e2455347ea8587eab6d9a5e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:43 user nova-compute[76049]: INFO nova.virt.block_device [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Booting with volume 1ade6fb4-0436-483a-b3b0-fb4a90adc4df at /dev/vda
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG os_brick.utils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:09:43 user nova-compute[76049]: INFO oslo.privsep.daemon [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpagmsotpc/privsep.sock']
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3 --force-share --output=json" returned: 0 in 0.279s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:43 user sudo[85783]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpagmsotpc/privsep.sock
Nov 15 11:09:43 user sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Cannot resize image /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Ensure instance console log exists: /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updating instance_info_cache with network_info: [{"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Releasing lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Instance network_info: |[{"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Start _get_guest_xml network_info=[{"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:09:43 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:43 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1269978556',display_name='tempest-VolumesAdminNegativeTest-server-1269978556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1269978556',id=3,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX0Qmywz6xgzg3LhZJtVqH7jdeBItRv7Bd4F3K4A8udUQhppO2GzDZyULG2rmhk7aWQbnamvLttwh/MjnWwkguFg6brZl4kfYt5kO9Wmq2N/NLLd/wIOnf7hzWgnTShtQ==',key_name='tempest-keypair-943534225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1b6dce9c3847f1be9a07015b683421',ramdisk_id='',reservation_id='r-adh9jzki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-448739573',owner_user_name='tempest-VolumesAdminNegativeTest-448739573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='543673d5b4f241df830806894717043f',uuid=cc582aae-00f7-4c3d-b551-a70aac92d7ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converting VIF {"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b6:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aa140e7-30ef-4482-a23f-d95d0b2a9da9,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa140e7-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.objects.instance [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lazy-loading 'pci_devices' on Instance uuid cc582aae-00f7-4c3d-b551-a70aac92d7ac {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:09:44 user nova-compute[76049]:   <uuid>cc582aae-00f7-4c3d-b551-a70aac92d7ac</uuid>
Nov 15 11:09:44 user nova-compute[76049]:   <name>instance-00000003</name>
Nov 15 11:09:44 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:09:44 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:09:44 user nova-compute[76049]:   <metadata>
Nov 15 11:09:44 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:09:44 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:09:44 user nova-compute[76049]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1269978556</nova:name>
Nov 15 11:09:44 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:09:43</nova:creationTime>
Nov 15 11:09:44 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:09:44 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:09:44 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:09:44 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:09:44 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:09:44 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:09:44 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:09:44 user nova-compute[76049]:       <nova:owner>
Nov 15 11:09:44 user nova-compute[76049]:         <nova:user uuid="543673d5b4f241df830806894717043f">tempest-VolumesAdminNegativeTest-448739573-project-member</nova:user>
Nov 15 11:09:44 user nova-compute[76049]:         <nova:project uuid="0b1b6dce9c3847f1be9a07015b683421">tempest-VolumesAdminNegativeTest-448739573</nova:project>
Nov 15 11:09:44 user nova-compute[76049]:       </nova:owner>
Nov 15 11:09:44 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:09:44 user nova-compute[76049]:       <nova:ports>
Nov 15 11:09:44 user nova-compute[76049]:         <nova:port uuid="1aa140e7-30ef-4482-a23f-d95d0b2a9da9">
Nov 15 11:09:44 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 11:09:44 user nova-compute[76049]:         </nova:port>
Nov 15 11:09:44 user nova-compute[76049]:       </nova:ports>
Nov 15 11:09:44 user nova-compute[76049]:     </nova:instance>
Nov 15 11:09:44 user nova-compute[76049]:   </metadata>
Nov 15 11:09:44 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:09:44 user nova-compute[76049]:     <system>
Nov 15 11:09:44 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:09:44 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:09:44 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:09:44 user nova-compute[76049]:       <entry name="serial">cc582aae-00f7-4c3d-b551-a70aac92d7ac</entry>
Nov 15 11:09:44 user nova-compute[76049]:       <entry name="uuid">cc582aae-00f7-4c3d-b551-a70aac92d7ac</entry>
Nov 15 11:09:44 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:09:44 user nova-compute[76049]:     </system>
Nov 15 11:09:44 user nova-compute[76049]:   </sysinfo>
Nov 15 11:09:44 user nova-compute[76049]:   <os>
Nov 15 11:09:44 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:09:44 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:09:44 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:09:44 user nova-compute[76049]:   </os>
Nov 15 11:09:44 user nova-compute[76049]:   <features>
Nov 15 11:09:44 user nova-compute[76049]:     <acpi/>
Nov 15 11:09:44 user nova-compute[76049]:     <apic/>
Nov 15 11:09:44 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:09:44 user nova-compute[76049]:   </features>
Nov 15 11:09:44 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:09:44 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:09:44 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:09:44 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:09:44 user nova-compute[76049]:   </clock>
Nov 15 11:09:44 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:09:44 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:09:44 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:09:44 user nova-compute[76049]:   </cpu>
Nov 15 11:09:44 user nova-compute[76049]:   <devices>
Nov 15 11:09:44 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:09:44 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:09:44 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk"/>
Nov 15 11:09:44 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:09:44 user nova-compute[76049]:     </disk>
Nov 15 11:09:44 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:09:44 user nova-compute[76049]:       <mac address="fa:16:3e:f7:b6:6c"/>
Nov 15 11:09:44 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:44 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:09:44 user nova-compute[76049]:       <target dev="tap1aa140e7-30"/>
Nov 15 11:09:44 user nova-compute[76049]:     </interface>
Nov 15 11:09:44 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:09:44 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/console.log" append="off"/>
Nov 15 11:09:44 user nova-compute[76049]:     </serial>
Nov 15 11:09:44 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:09:44 user nova-compute[76049]:     <video>
Nov 15 11:09:44 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:44 user nova-compute[76049]:     </video>
Nov 15 11:09:44 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:09:44 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:09:44 user nova-compute[76049]:     </rng>
Nov 15 11:09:44 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:09:44 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:09:44 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:09:44 user nova-compute[76049]:     </memballoon>
Nov 15 11:09:44 user nova-compute[76049]:   </devices>
Nov 15 11:09:44 user nova-compute[76049]: </domain>
Nov 15 11:09:44 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1269978556',display_name='tempest-VolumesAdminNegativeTest-server-1269978556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1269978556',id=3,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX0Qmywz6xgzg3LhZJtVqH7jdeBItRv7Bd4F3K4A8udUQhppO2GzDZyULG2rmhk7aWQbnamvLttwh/MjnWwkguFg6brZl4kfYt5kO9Wmq2N/NLLd/wIOnf7hzWgnTShtQ==',key_name='tempest-keypair-943534225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1b6dce9c3847f1be9a07015b683421',ramdisk_id='',reservation_id='r-adh9jzki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-448739573',owner_user_name='tempest-VolumesAdminNegativeTest-448739573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='543673d5b4f241df830806894717043f',uuid=cc582aae-00f7-4c3d-b551-a70aac92d7ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converting VIF {"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b6:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aa140e7-30ef-4482-a23f-d95d0b2a9da9,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa140e7-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG os_vif [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b6:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aa140e7-30ef-4482-a23f-d95d0b2a9da9,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa140e7-30') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7e07fc-6a02-5ca3-9026-4cdce6726cbf', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aa140e7-30, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aa140e7-30, col_values=(('qos', UUID('1b249fb1-8154-44e3-a15a-e40a1c04151a')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aa140e7-30, col_values=(('external_ids', {'iface-id': '1aa140e7-30ef-4482-a23f-d95d0b2a9da9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:b6:6c', 'vm-uuid': 'cc582aae-00f7-4c3d-b551-a70aac92d7ac'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:44 user nova-compute[76049]: INFO os_vif [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b6:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aa140e7-30ef-4482-a23f-d95d0b2a9da9,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa140e7-30')
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Successfully created port: cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] No VIF found with MAC fa:16:3e:f7:b6:6c, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.policy [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee64d748ff8940748cbddf050539088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01388fdbea2f40b38a8c4dd5f8c922c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Creating image(s)
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Successfully created port: 790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk 1073741824" returned: 0 in 0.063s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.224s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:45 user sudo[85783]: pam_unix(sudo:session): session closed for user root
Nov 15 11:09:45 user nova-compute[76049]: INFO oslo.privsep.daemon [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Spawned new privsep daemon via rootwrap
Nov 15 11:09:45 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 11:09:45 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 11:09:45 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 11:09:45 user nova-compute[76049]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85916
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[073af78e-39ad-488f-b488-65f8bf65066b]: (2,) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Cannot resize image /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Ensure instance console log exists: /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[148d14bf-d1dc-43ae-b441-2e3230fc2f58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:45 user nova-compute[76049]: WARNING os_brick.initiator.connectors.nvmeof [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411f70b-a5d5-41f6-8c94-97f927d01ee5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96aff95-fc9e-4a4e-a4de-61d5abff380d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff285d-eafe-47f6-be37-a27ea80b8fb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:09:45 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e1b32b-6330-4032-8290-756551f267b4]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG os_brick.utils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] <== get_connector_properties: return (2195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updating existing volume attachment record: c9b1cc0f-4bda-4bad-b6d7-eac1b382aa78 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Successfully created port: 3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Successfully updated port: 790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquired lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.compute.manager [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-changed-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.compute.manager [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Refreshing instance network info cache due to event network-changed-790cd537-de81-4c38-b956-e7844fe08df4. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] Acquiring lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Successfully updated port: cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquired lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updating instance_info_cache with network_info: [{"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Releasing lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance network_info: |[{"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] Acquired lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.network.neutron [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Refreshing network info cache for port 790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-changed-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Refreshing instance network info cache due to event network-changed-cc2067b4-33bb-4cf7-9a0f-d7c2537308be. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] Acquiring lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Updating instance_info_cache with network_info: [{"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Releasing lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Instance network_info: |[{"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] Acquired lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.network.neutron [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Refreshing network info cache for port cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Start _get_guest_xml network_info=[{"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:09:29Z,direct_url=<?>,disk_format='qcow2',id=8e16a4a9-58c6-417f-943b-731a6dee758c,min_disk=0,min_ram=0,name='',owner='c247e9bf909f48dab47512a86ebb9c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:09:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '8e16a4a9-58c6-417f-943b-731a6dee758c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:09:46 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:46 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:09:29Z,direct_url=<?>,disk_format='qcow2',id=8e16a4a9-58c6-417f-943b-731a6dee758c,min_disk=0,min_ram=0,name='',owner='c247e9bf909f48dab47512a86ebb9c4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:09:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:09:46 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-6786248',display_name='tempest-AttachSCSIVolumeTestJSON-server-6786248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-6786248',id=4,image_ref='8e16a4a9-58c6-417f-943b-731a6dee758c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd8l2jjXHBwXss56Uvdf40JpWfhHoepZEMNwKQEhYuiPKaCPjam5bd7QTTIiuGAzTtWjFTHSOyme9qeHbWIiC1tK/neysg7366RH5J1+shPtivYa4m2M7aKPEr0Z+5vag==',key_name='tempest-keypair-1470040639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0e67b1b1604fd9b8a72b6e9f8f426e',ramdisk_id='',reservation_id='r-f69tcpj0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e16a4a9-58c6-417f-943b-731a6dee758c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-846648667',owner_user_name='tempest-AttachSCSIVolumeTestJSON-846648667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='862bd9d989bc4ca586e0c65c4fdd7069',uuid=a920e6ce-95d2-445c-b485-548da3d81042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Converting VIF {"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:70:83,bridge_name='br-int',has_traffic_filtering=True,id=cc2067b4-33bb-4cf7-9a0f-d7c2537308be,network=Network(cb0c0241-3e37-47a2-96d8-d8eb31c58df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2067b4-33') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.objects.instance [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lazy-loading 'pci_devices' on Instance uuid a920e6ce-95d2-445c-b485-548da3d81042 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updated VIF entry in instance network info cache for port 790cd537-de81-4c38-b956-e7844fe08df4. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updating instance_info_cache with network_info: [{"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-c6468966-ad2a-40ea-a2aa-e28851794cf9 req-4b9a2a72-421c-41fd-842d-6ed96bac3cc7 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c6468966-ad2a-40ea-a2aa-e28851794cf9 req-4b9a2a72-421c-41fd-842d-6ed96bac3cc7 service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c6468966-ad2a-40ea-a2aa-e28851794cf9 req-4b9a2a72-421c-41fd-842d-6ed96bac3cc7 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c6468966-ad2a-40ea-a2aa-e28851794cf9 req-4b9a2a72-421c-41fd-842d-6ed96bac3cc7 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-c6468966-ad2a-40ea-a2aa-e28851794cf9 req-4b9a2a72-421c-41fd-842d-6ed96bac3cc7 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:09:47 user nova-compute[76049]: WARNING nova.compute.manager [req-c6468966-ad2a-40ea-a2aa-e28851794cf9 req-4b9a2a72-421c-41fd-842d-6ed96bac3cc7 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state active and task_state None.
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:09:47 user nova-compute[76049]:   <uuid>a920e6ce-95d2-445c-b485-548da3d81042</uuid>
Nov 15 11:09:47 user nova-compute[76049]:   <name>instance-00000004</name>
Nov 15 11:09:47 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:09:47 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:09:47 user nova-compute[76049]:   <metadata>
Nov 15 11:09:47 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:09:47 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:09:47 user nova-compute[76049]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-6786248</nova:name>
Nov 15 11:09:47 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:09:46</nova:creationTime>
Nov 15 11:09:47 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:09:47 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:09:47 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:09:47 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:09:47 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:09:47 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:09:47 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:09:47 user nova-compute[76049]:       <nova:owner>
Nov 15 11:09:47 user nova-compute[76049]:         <nova:user uuid="862bd9d989bc4ca586e0c65c4fdd7069">tempest-AttachSCSIVolumeTestJSON-846648667-project-member</nova:user>
Nov 15 11:09:47 user nova-compute[76049]:         <nova:project uuid="4d0e67b1b1604fd9b8a72b6e9f8f426e">tempest-AttachSCSIVolumeTestJSON-846648667</nova:project>
Nov 15 11:09:47 user nova-compute[76049]:       </nova:owner>
Nov 15 11:09:47 user nova-compute[76049]:       <nova:root type="image" uuid="8e16a4a9-58c6-417f-943b-731a6dee758c"/>
Nov 15 11:09:47 user nova-compute[76049]:       <nova:ports>
Nov 15 11:09:47 user nova-compute[76049]:         <nova:port uuid="cc2067b4-33bb-4cf7-9a0f-d7c2537308be">
Nov 15 11:09:47 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 11:09:47 user nova-compute[76049]:         </nova:port>
Nov 15 11:09:47 user nova-compute[76049]:       </nova:ports>
Nov 15 11:09:47 user nova-compute[76049]:     </nova:instance>
Nov 15 11:09:47 user nova-compute[76049]:   </metadata>
Nov 15 11:09:47 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:09:47 user nova-compute[76049]:     <system>
Nov 15 11:09:47 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:09:47 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:09:47 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:09:47 user nova-compute[76049]:       <entry name="serial">a920e6ce-95d2-445c-b485-548da3d81042</entry>
Nov 15 11:09:47 user nova-compute[76049]:       <entry name="uuid">a920e6ce-95d2-445c-b485-548da3d81042</entry>
Nov 15 11:09:47 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:09:47 user nova-compute[76049]:     </system>
Nov 15 11:09:47 user nova-compute[76049]:   </sysinfo>
Nov 15 11:09:47 user nova-compute[76049]:   <os>
Nov 15 11:09:47 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:09:47 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:09:47 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:09:47 user nova-compute[76049]:   </os>
Nov 15 11:09:47 user nova-compute[76049]:   <features>
Nov 15 11:09:47 user nova-compute[76049]:     <acpi/>
Nov 15 11:09:47 user nova-compute[76049]:     <apic/>
Nov 15 11:09:47 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:09:47 user nova-compute[76049]:   </features>
Nov 15 11:09:47 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:09:47 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:09:47 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:09:47 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:09:47 user nova-compute[76049]:   </clock>
Nov 15 11:09:47 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:09:47 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:09:47 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:09:47 user nova-compute[76049]:   </cpu>
Nov 15 11:09:47 user nova-compute[76049]:   <devices>
Nov 15 11:09:47 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:09:47 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:09:47 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk"/>
Nov 15 11:09:47 user nova-compute[76049]:       <target dev="sda" bus="scsi"/>
Nov 15 11:09:47 user nova-compute[76049]:       <address type="drive" controller="0" unit="0"/>
Nov 15 11:09:47 user nova-compute[76049]:     </disk>
Nov 15 11:09:47 user nova-compute[76049]:     <disk type="file" device="cdrom">
Nov 15 11:09:47 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 11:09:47 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk.config"/>
Nov 15 11:09:47 user nova-compute[76049]:       <target dev="sdb" bus="scsi"/>
Nov 15 11:09:47 user nova-compute[76049]:       <address type="drive" controller="0" unit="1"/>
Nov 15 11:09:47 user nova-compute[76049]:     </disk>
Nov 15 11:09:47 user nova-compute[76049]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 11:09:47 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:09:47 user nova-compute[76049]:       <mac address="fa:16:3e:ec:70:83"/>
Nov 15 11:09:47 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:47 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:09:47 user nova-compute[76049]:       <target dev="tapcc2067b4-33"/>
Nov 15 11:09:47 user nova-compute[76049]:     </interface>
Nov 15 11:09:47 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:09:47 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/console.log" append="off"/>
Nov 15 11:09:47 user nova-compute[76049]:     </serial>
Nov 15 11:09:47 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:09:47 user nova-compute[76049]:     <video>
Nov 15 11:09:47 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:47 user nova-compute[76049]:     </video>
Nov 15 11:09:47 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:09:47 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:09:47 user nova-compute[76049]:     </rng>
Nov 15 11:09:47 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:09:47 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:09:47 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:09:47 user nova-compute[76049]:     </memballoon>
Nov 15 11:09:47 user nova-compute[76049]:   </devices>
Nov 15 11:09:47 user nova-compute[76049]: </domain>
Nov 15 11:09:47 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-6786248',display_name='tempest-AttachSCSIVolumeTestJSON-server-6786248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-6786248',id=4,image_ref='8e16a4a9-58c6-417f-943b-731a6dee758c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd8l2jjXHBwXss56Uvdf40JpWfhHoepZEMNwKQEhYuiPKaCPjam5bd7QTTIiuGAzTtWjFTHSOyme9qeHbWIiC1tK/neysg7366RH5J1+shPtivYa4m2M7aKPEr0Z+5vag==',key_name='tempest-keypair-1470040639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0e67b1b1604fd9b8a72b6e9f8f426e',ramdisk_id='',reservation_id='r-f69tcpj0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e16a4a9-58c6-417f-943b-731a6dee758c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-846648667',owner_user_name='tempest-AttachSCSIVolumeTestJSON-846648667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='862bd9d989bc4ca586e0c65c4fdd7069',uuid=a920e6ce-95d2-445c-b485-548da3d81042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Converting VIF {"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:70:83,bridge_name='br-int',has_traffic_filtering=True,id=cc2067b4-33bb-4cf7-9a0f-d7c2537308be,network=Network(cb0c0241-3e37-47a2-96d8-d8eb31c58df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2067b4-33') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG os_vif [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:70:83,bridge_name='br-int',has_traffic_filtering=True,id=cc2067b4-33bb-4cf7-9a0f-d7c2537308be,network=Network(cb0c0241-3e37-47a2-96d8-d8eb31c58df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2067b4-33') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ed92255e-35cd-4c07-ae53-e8d5bb152889 req-c787540f-1be8-4165-aa00-d156939fc5de service nova] Releasing lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b818357-a94d-5f8a-be5e-697b00c7a46c', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc2067b4-33, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc2067b4-33, col_values=(('qos', UUID('9de2bd29-4e6c-477c-9467-a60a73786735')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc2067b4-33, col_values=(('external_ids', {'iface-id': 'cc2067b4-33bb-4cf7-9a0f-d7c2537308be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:70:83', 'vm-uuid': 'a920e6ce-95d2-445c-b485-548da3d81042'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:47 user nova-compute[76049]: INFO os_vif [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:70:83,bridge_name='br-int',has_traffic_filtering=True,id=cc2067b4-33bb-4cf7-9a0f-d7c2537308be,network=Network(cb0c0241-3e37-47a2-96d8-d8eb31c58df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2067b4-33')
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] No BDM found with device name sda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] No VIF found with MAC fa:16:3e:ec:70:83, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:09:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Using config drive
Nov 15 11:09:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Creating config drive at /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk.config
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0r_1plq0 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Updated VIF entry in instance network info cache for port cc2067b4-33bb-4cf7-9a0f-d7c2537308be. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Updating instance_info_cache with network_info: [{"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0r_1plq0" returned: 0 in 0.071s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0ce74794-30f8-4ca2-9cbd-241f659e11a1 req-02431a8c-1639-47f6-a9eb-6707ebd219f8 service nova] Releasing lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Successfully updated port: 3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquired lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:09:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:09:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Instance spawned successfully.
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:48 user nova-compute[76049]: INFO nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Took 10.09 seconds to spawn the instance on the hypervisor.
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:09:48 user nova-compute[76049]: INFO nova.compute.manager [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Took 11.22 seconds to build instance.
Nov 15 11:09:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-badfa5dd-425f-407b-a7e6-35d9da977036 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.387s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Releasing lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Instance network_info: |[{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Start _get_guest_xml network_info=[{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:09:48 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:48 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converting VIF {"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:28:bc,bridge_name='br-int',has_traffic_filtering=True,id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab,network=Network(77323d6c-f42c-4ec3-95a1-a6e5c809c467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9f20e6-2c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:48 user nova-compute[76049]: DEBUG nova.objects.instance [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'pci_devices' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:09:49 user nova-compute[76049]:   <uuid>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</uuid>
Nov 15 11:09:49 user nova-compute[76049]:   <name>instance-00000006</name>
Nov 15 11:09:49 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:09:49 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:09:49 user nova-compute[76049]:   <metadata>
Nov 15 11:09:49 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:09:49 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:09:49 user nova-compute[76049]:       <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:09:49 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:09:48</nova:creationTime>
Nov 15 11:09:49 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:09:49 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:09:49 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:09:49 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:09:49 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:09:49 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:09:49 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:09:49 user nova-compute[76049]:       <nova:owner>
Nov 15 11:09:49 user nova-compute[76049]:         <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:09:49 user nova-compute[76049]:         <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:09:49 user nova-compute[76049]:       </nova:owner>
Nov 15 11:09:49 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:09:49 user nova-compute[76049]:       <nova:ports>
Nov 15 11:09:49 user nova-compute[76049]:         <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:09:49 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:09:49 user nova-compute[76049]:         </nova:port>
Nov 15 11:09:49 user nova-compute[76049]:       </nova:ports>
Nov 15 11:09:49 user nova-compute[76049]:     </nova:instance>
Nov 15 11:09:49 user nova-compute[76049]:   </metadata>
Nov 15 11:09:49 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:09:49 user nova-compute[76049]:     <system>
Nov 15 11:09:49 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:09:49 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:09:49 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:09:49 user nova-compute[76049]:       <entry name="serial">60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:09:49 user nova-compute[76049]:       <entry name="uuid">60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:09:49 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:09:49 user nova-compute[76049]:     </system>
Nov 15 11:09:49 user nova-compute[76049]:   </sysinfo>
Nov 15 11:09:49 user nova-compute[76049]:   <os>
Nov 15 11:09:49 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:09:49 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:09:49 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:09:49 user nova-compute[76049]:   </os>
Nov 15 11:09:49 user nova-compute[76049]:   <features>
Nov 15 11:09:49 user nova-compute[76049]:     <acpi/>
Nov 15 11:09:49 user nova-compute[76049]:     <apic/>
Nov 15 11:09:49 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:09:49 user nova-compute[76049]:   </features>
Nov 15 11:09:49 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:09:49 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:09:49 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:09:49 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:09:49 user nova-compute[76049]:   </clock>
Nov 15 11:09:49 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:09:49 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:09:49 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:09:49 user nova-compute[76049]:   </cpu>
Nov 15 11:09:49 user nova-compute[76049]:   <devices>
Nov 15 11:09:49 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:09:49 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:09:49 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk"/>
Nov 15 11:09:49 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:09:49 user nova-compute[76049]:     </disk>
Nov 15 11:09:49 user nova-compute[76049]:     <disk type="file" device="cdrom">
Nov 15 11:09:49 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 11:09:49 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config"/>
Nov 15 11:09:49 user nova-compute[76049]:       <target dev="hda" bus="ide"/>
Nov 15 11:09:49 user nova-compute[76049]:     </disk>
Nov 15 11:09:49 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:09:49 user nova-compute[76049]:       <mac address="fa:16:3e:da:28:bc"/>
Nov 15 11:09:49 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:49 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:09:49 user nova-compute[76049]:       <target dev="tap3b9f20e6-2c"/>
Nov 15 11:09:49 user nova-compute[76049]:     </interface>
Nov 15 11:09:49 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:09:49 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log" append="off"/>
Nov 15 11:09:49 user nova-compute[76049]:     </serial>
Nov 15 11:09:49 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:09:49 user nova-compute[76049]:     <video>
Nov 15 11:09:49 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:49 user nova-compute[76049]:     </video>
Nov 15 11:09:49 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:09:49 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:09:49 user nova-compute[76049]:     </rng>
Nov 15 11:09:49 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:09:49 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:09:49 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:09:49 user nova-compute[76049]:     </memballoon>
Nov 15 11:09:49 user nova-compute[76049]:   </devices>
Nov 15 11:09:49 user nova-compute[76049]: </domain>
Nov 15 11:09:49 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converting VIF {"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:28:bc,bridge_name='br-int',has_traffic_filtering=True,id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab,network=Network(77323d6c-f42c-4ec3-95a1-a6e5c809c467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9f20e6-2c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG os_vif [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:28:bc,bridge_name='br-int',has_traffic_filtering=True,id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab,network=Network(77323d6c-f42c-4ec3-95a1-a6e5c809c467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9f20e6-2c') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ede1e55-203f-5253-98c8-aa3acb7331aa', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b9f20e6-2c, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b9f20e6-2c, col_values=(('qos', UUID('646bb8fb-cd29-4ef6-bf28-d7ea7d27cb60')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b9f20e6-2c, col_values=(('external_ids', {'iface-id': '3b9f20e6-2c85-4c46-bf59-4919ee8731ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:28:bc', 'vm-uuid': '60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:09:49 user nova-compute[76049]: WARNING nova.compute.manager [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state active and task_state None.
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-changed-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Refreshing instance network info cache due to event network-changed-3b9f20e6-2c85-4c46-bf59-4919ee8731ab. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] Acquiring lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] Acquired lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Refreshing network info cache for port 3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:49 user nova-compute[76049]: INFO os_vif [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:28:bc,bridge_name='br-int',has_traffic_filtering=True,id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab,network=Network(77323d6c-f42c-4ec3-95a1-a6e5c809c467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9f20e6-2c')
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No BDM found with device name hda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No VIF found with MAC fa:16:3e:da:28:bc, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:09:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Using config drive
Nov 15 11:09:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Creating config drive at /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config
Nov 15 11:09:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptsd6f9lk {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptsd6f9lk" returned: 0 in 0.083s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:50 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updated VIF entry in instance network info cache for port 3b9f20e6-2c85-4c46-bf59-4919ee8731ab. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:09:50 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b6e370e-46d4-440b-a1ca-a51e5dff6bb0 req-3395a75b-389e-43ac-b645-9fc2b5c215e9 service nova] Releasing lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:09:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:09:52 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Instance spawned successfully.
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:52 user nova-compute[76049]: INFO nova.compute.claims [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Claim successful on node user
Nov 15 11:09:52 user nova-compute[76049]: INFO nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Took 10.90 seconds to spawn the instance on the hypervisor.
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:09:52 user nova-compute[76049]: INFO nova.compute.manager [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Took 12.99 seconds to build instance.
Nov 15 11:09:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dc2fc33c-c675-4e37-bee4-5224614f0645 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.220s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:52 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Creating image(s)
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "/opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "/opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "/opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.217s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.policy [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6cbd6f62ba045688364e0241df4fdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ade19cfa6249d5939ab07e413a9466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk 1073741824" returned: 0 in 0.075s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.263s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Creating image(s)
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Ensure instance console log exists: /opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Start _get_guest_xml network_info=[{"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c14698a2-4375-4eff-b590-da9bd6b705c3', 'attached_at': '', 'detached_at': '', 'volume_id': '1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'serial': '1ade6fb4-0436-483a-b3b0-fb4a90adc4df'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'c9b1cc0f-4bda-4bad-b6d7-eac1b382aa78', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:09:53 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:53 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG os_brick.initiator.connector [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Factory for ISCSI on None {{(pid=76049) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:09:53 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:09:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:09:53 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:09:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:09:53 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0423111c-bbbb-4ce6-b014-6145f1a49c4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:09:53 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c95b5f-e4f0-4fc1-955f-b521cf8788a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df] added
Nov 15 11:09:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Cannot resize image /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Ensure instance console log exists: /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[749c4c73-15e2-4d94-8320-9336eef0a573]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[87906bc9-8620-4529-a698-87c9e84204de]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilEkYyuJ {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilEkYyuJ" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd655a5d-e158-4213-b828-6eb38d17f5ce]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ilEkYyuJ'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ecc3c-c49f-49c1-b286-cd9f4970e5df]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:09:54 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Instance spawned successfully.
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeeb54a-dcba-41db-a03d-5926d7a5e7b6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:09:54 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:09:54 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:09:54 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 11:09:54 user nova-compute[76049]: 
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[202b2be9-3711-42fa-b8de-a2a4f21efbb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]
Nov 15 11:09:54 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.
Nov 15 11:09:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ed195e-043d-475e-805b-eabf045c6ea2]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9fab8-34ec-43a0-9347-f03694adf734]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:09:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:09:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:09:54 user nova-compute[76049]: INFO nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Took 9.81 seconds to spawn the instance on the hypervisor.
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ea17d-0834-4484-a450-c6729d14d04c]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:09:54 user nova-compute[76049]: INFO nova.compute.manager [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Took 11.44 seconds to build instance.
Nov 15 11:09:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-dd266849-f48e-45df-9ce2-a2e1e1a77e30 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.666s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Successfully created port: 1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23432323964326166', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432323964326166', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1455564423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455564423',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiooTyBAMDa34L+spwsKuK/KxqusfIwhUiudamwQEO/wUTf8kPInujstho24FharspFIqdn/7mX+Fd8wvkB2FKkESOxD8uzJgNhYyHhArruHSEXQlyv7Qs3FlJBuDislw==',key_name='tempest-keypair-1043338373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='554876e2455347ea8587eab6d9a5e72a',ramdisk_id='',reservation_id='r-istarf3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1321113087',owner_user_name='tempest-ServerActionsV293TestJSON-1321113087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5ae3fcc46c4fd1834660eb48910332',uuid=c14698a2-4375-4eff-b590-da9bd6b705c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converting VIF {"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lazy-loading 'pci_devices' on Instance uuid c14698a2-4375-4eff-b590-da9bd6b705c3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:09:55 user nova-compute[76049]:   <uuid>c14698a2-4375-4eff-b590-da9bd6b705c3</uuid>
Nov 15 11:09:55 user nova-compute[76049]:   <name>instance-00000005</name>
Nov 15 11:09:55 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:09:55 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:09:55 user nova-compute[76049]:   <metadata>
Nov 15 11:09:55 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:09:55 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:09:55 user nova-compute[76049]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1455564423</nova:name>
Nov 15 11:09:55 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:09:53</nova:creationTime>
Nov 15 11:09:55 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:09:55 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:09:55 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:09:55 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:09:55 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:09:55 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:09:55 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:09:55 user nova-compute[76049]:       <nova:owner>
Nov 15 11:09:55 user nova-compute[76049]:         <nova:user uuid="9e5ae3fcc46c4fd1834660eb48910332">tempest-ServerActionsV293TestJSON-1321113087-project-member</nova:user>
Nov 15 11:09:55 user nova-compute[76049]:         <nova:project uuid="554876e2455347ea8587eab6d9a5e72a">tempest-ServerActionsV293TestJSON-1321113087</nova:project>
Nov 15 11:09:55 user nova-compute[76049]:       </nova:owner>
Nov 15 11:09:55 user nova-compute[76049]:       <nova:ports>
Nov 15 11:09:55 user nova-compute[76049]:         <nova:port uuid="790cd537-de81-4c38-b956-e7844fe08df4">
Nov 15 11:09:55 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:09:55 user nova-compute[76049]:         </nova:port>
Nov 15 11:09:55 user nova-compute[76049]:       </nova:ports>
Nov 15 11:09:55 user nova-compute[76049]:     </nova:instance>
Nov 15 11:09:55 user nova-compute[76049]:   </metadata>
Nov 15 11:09:55 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:09:55 user nova-compute[76049]:     <system>
Nov 15 11:09:55 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:09:55 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:09:55 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:09:55 user nova-compute[76049]:       <entry name="serial">c14698a2-4375-4eff-b590-da9bd6b705c3</entry>
Nov 15 11:09:55 user nova-compute[76049]:       <entry name="uuid">c14698a2-4375-4eff-b590-da9bd6b705c3</entry>
Nov 15 11:09:55 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:09:55 user nova-compute[76049]:     </system>
Nov 15 11:09:55 user nova-compute[76049]:   </sysinfo>
Nov 15 11:09:55 user nova-compute[76049]:   <os>
Nov 15 11:09:55 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:09:55 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:09:55 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:09:55 user nova-compute[76049]:   </os>
Nov 15 11:09:55 user nova-compute[76049]:   <features>
Nov 15 11:09:55 user nova-compute[76049]:     <acpi/>
Nov 15 11:09:55 user nova-compute[76049]:     <apic/>
Nov 15 11:09:55 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:09:55 user nova-compute[76049]:   </features>
Nov 15 11:09:55 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:09:55 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:09:55 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:09:55 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:09:55 user nova-compute[76049]:   </clock>
Nov 15 11:09:55 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:09:55 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:09:55 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:09:55 user nova-compute[76049]:   </cpu>
Nov 15 11:09:55 user nova-compute[76049]:   <devices>
Nov 15 11:09:55 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:09:55 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:09:55 user nova-compute[76049]:       <source dev="/dev/sdb"/>
Nov 15 11:09:55 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:09:55 user nova-compute[76049]:       <serial>1ade6fb4-0436-483a-b3b0-fb4a90adc4df</serial>
Nov 15 11:09:55 user nova-compute[76049]:     </disk>
Nov 15 11:09:55 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:09:55 user nova-compute[76049]:       <mac address="fa:16:3e:b6:03:77"/>
Nov 15 11:09:55 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:55 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:09:55 user nova-compute[76049]:       <target dev="tap790cd537-de"/>
Nov 15 11:09:55 user nova-compute[76049]:     </interface>
Nov 15 11:09:55 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:09:55 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3/console.log" append="off"/>
Nov 15 11:09:55 user nova-compute[76049]:     </serial>
Nov 15 11:09:55 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:09:55 user nova-compute[76049]:     <video>
Nov 15 11:09:55 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:55 user nova-compute[76049]:     </video>
Nov 15 11:09:55 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:09:55 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:09:55 user nova-compute[76049]:     </rng>
Nov 15 11:09:55 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:09:55 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:09:55 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:09:55 user nova-compute[76049]:     </memballoon>
Nov 15 11:09:55 user nova-compute[76049]:   </devices>
Nov 15 11:09:55 user nova-compute[76049]: </domain>
Nov 15 11:09:55 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1455564423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455564423',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiooTyBAMDa34L+spwsKuK/KxqusfIwhUiudamwQEO/wUTf8kPInujstho24FharspFIqdn/7mX+Fd8wvkB2FKkESOxD8uzJgNhYyHhArruHSEXQlyv7Qs3FlJBuDislw==',key_name='tempest-keypair-1043338373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='554876e2455347ea8587eab6d9a5e72a',ramdisk_id='',reservation_id='r-istarf3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1321113087',owner_user_name='tempest-ServerActionsV293TestJSON-1321113087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5ae3fcc46c4fd1834660eb48910332',uuid=c14698a2-4375-4eff-b590-da9bd6b705c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converting VIF {"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG os_vif [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f928f4d-fc1a-51c5-8bb1-9bc863e3f864', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap790cd537-de, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap790cd537-de, col_values=(('qos', UUID('5001b841-a877-41da-b5b2-050437a46cad')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap790cd537-de, col_values=(('external_ids', {'iface-id': '790cd537-de81-4c38-b956-e7844fe08df4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:03:77', 'vm-uuid': 'c14698a2-4375-4eff-b590-da9bd6b705c3'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:55 user nova-compute[76049]: INFO os_vif [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de')
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] No VIF found with MAC fa:16:3e:b6:03:77, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-0d5a9dc1-6df2-4cee-94d6-522edbc0e235 req-4e720199-896a-4e28-adbe-c5590385e013 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d5a9dc1-6df2-4cee-94d6-522edbc0e235 req-4e720199-896a-4e28-adbe-c5590385e013 service nova] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d5a9dc1-6df2-4cee-94d6-522edbc0e235 req-4e720199-896a-4e28-adbe-c5590385e013 service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d5a9dc1-6df2-4cee-94d6-522edbc0e235 req-4e720199-896a-4e28-adbe-c5590385e013 service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-0d5a9dc1-6df2-4cee-94d6-522edbc0e235 req-4e720199-896a-4e28-adbe-c5590385e013 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] No waiting events found dispatching network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:09:56 user nova-compute[76049]: WARNING nova.compute.manager [req-0d5a9dc1-6df2-4cee-94d6-522edbc0e235 req-4e720199-896a-4e28-adbe-c5590385e013 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received unexpected event network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 for instance with vm_state active and task_state None.
Nov 15 11:09:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Successfully updated port: 1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "refresh_cache-a839d9dc-b17f-421b-ac5e-6a22cffd10fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquired lock "refresh_cache-a839d9dc-b17f-421b-ac5e-6a22cffd10fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "8a944329-f077-4be4-b780-492b9e9d978d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:09:56 user nova-compute[76049]: INFO nova.compute.claims [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Claim successful on node user
Nov 15 11:09:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:09:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:09:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:09:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:09:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Creating image(s)
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "/opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "/opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.policy [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '191cae5f6c3d46209098196bdbdc429a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceebd69126949f8a0522015570e74d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Updating instance_info_cache with network_info: [{"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.208s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Releasing lock "refresh_cache-a839d9dc-b17f-421b-ac5e-6a22cffd10fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Instance network_info: |[{"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Start _get_guest_xml network_info=[{"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:09:58 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:58 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1342677441',display_name='tempest-VolumesNegativeTest-instance-1342677441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1342677441',id=7,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ade19cfa6249d5939ab07e413a9466',ramdisk_id='',reservation_id='r-zysygraf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1965965135',owner_user_name='tempest-VolumesNegativeTest-1965965135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:53Z,user_data=None,user_id='d6cbd6f62ba045688364e0241df4fdbd',uuid=a839d9dc-b17f-421b-ac5e-6a22cffd10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Converting VIF {"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:9a,bridge_name='br-int',has_traffic_filtering=True,id=1dff976f-9c20-4915-aeca-1baac9b43a0a,network=Network(250f6248-34e4-4fb4-b4df-3aa0ccaae93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dff976f-9c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lazy-loading 'pci_devices' on Instance uuid a839d9dc-b17f-421b-ac5e-6a22cffd10fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received event network-changed-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Refreshing instance network info cache due to event network-changed-1dff976f-9c20-4915-aeca-1baac9b43a0a. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Acquiring lock "refresh_cache-a839d9dc-b17f-421b-ac5e-6a22cffd10fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Acquired lock "refresh_cache-a839d9dc-b17f-421b-ac5e-6a22cffd10fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.network.neutron [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Refreshing network info cache for port 1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:09:58 user nova-compute[76049]:   <uuid>a839d9dc-b17f-421b-ac5e-6a22cffd10fa</uuid>
Nov 15 11:09:58 user nova-compute[76049]:   <name>instance-00000007</name>
Nov 15 11:09:58 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:09:58 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:09:58 user nova-compute[76049]:   <metadata>
Nov 15 11:09:58 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:09:58 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:09:58 user nova-compute[76049]:       <nova:name>tempest-VolumesNegativeTest-instance-1342677441</nova:name>
Nov 15 11:09:58 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:09:58</nova:creationTime>
Nov 15 11:09:58 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:09:58 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:09:58 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:09:58 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:09:58 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:09:58 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:09:58 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:09:58 user nova-compute[76049]:       <nova:owner>
Nov 15 11:09:58 user nova-compute[76049]:         <nova:user uuid="d6cbd6f62ba045688364e0241df4fdbd">tempest-VolumesNegativeTest-1965965135-project-member</nova:user>
Nov 15 11:09:58 user nova-compute[76049]:         <nova:project uuid="97ade19cfa6249d5939ab07e413a9466">tempest-VolumesNegativeTest-1965965135</nova:project>
Nov 15 11:09:58 user nova-compute[76049]:       </nova:owner>
Nov 15 11:09:58 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:09:58 user nova-compute[76049]:       <nova:ports>
Nov 15 11:09:58 user nova-compute[76049]:         <nova:port uuid="1dff976f-9c20-4915-aeca-1baac9b43a0a">
Nov 15 11:09:58 user nova-compute[76049]:           <nova:ip type="fixed" address="192.168.233.84" ipVersion="4"/>
Nov 15 11:09:58 user nova-compute[76049]:         </nova:port>
Nov 15 11:09:58 user nova-compute[76049]:       </nova:ports>
Nov 15 11:09:58 user nova-compute[76049]:     </nova:instance>
Nov 15 11:09:58 user nova-compute[76049]:   </metadata>
Nov 15 11:09:58 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:09:58 user nova-compute[76049]:     <system>
Nov 15 11:09:58 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:09:58 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:09:58 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:09:58 user nova-compute[76049]:       <entry name="serial">a839d9dc-b17f-421b-ac5e-6a22cffd10fa</entry>
Nov 15 11:09:58 user nova-compute[76049]:       <entry name="uuid">a839d9dc-b17f-421b-ac5e-6a22cffd10fa</entry>
Nov 15 11:09:58 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:09:58 user nova-compute[76049]:     </system>
Nov 15 11:09:58 user nova-compute[76049]:   </sysinfo>
Nov 15 11:09:58 user nova-compute[76049]:   <os>
Nov 15 11:09:58 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:09:58 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:09:58 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:09:58 user nova-compute[76049]:   </os>
Nov 15 11:09:58 user nova-compute[76049]:   <features>
Nov 15 11:09:58 user nova-compute[76049]:     <acpi/>
Nov 15 11:09:58 user nova-compute[76049]:     <apic/>
Nov 15 11:09:58 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:09:58 user nova-compute[76049]:   </features>
Nov 15 11:09:58 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:09:58 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:09:58 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:09:58 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:09:58 user nova-compute[76049]:   </clock>
Nov 15 11:09:58 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:09:58 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:09:58 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:09:58 user nova-compute[76049]:   </cpu>
Nov 15 11:09:58 user nova-compute[76049]:   <devices>
Nov 15 11:09:58 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:09:58 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:09:58 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk"/>
Nov 15 11:09:58 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:09:58 user nova-compute[76049]:     </disk>
Nov 15 11:09:58 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:09:58 user nova-compute[76049]:       <mac address="fa:16:3e:79:86:9a"/>
Nov 15 11:09:58 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:58 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:09:58 user nova-compute[76049]:       <target dev="tap1dff976f-9c"/>
Nov 15 11:09:58 user nova-compute[76049]:     </interface>
Nov 15 11:09:58 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:09:58 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/console.log" append="off"/>
Nov 15 11:09:58 user nova-compute[76049]:     </serial>
Nov 15 11:09:58 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:09:58 user nova-compute[76049]:     <video>
Nov 15 11:09:58 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:09:58 user nova-compute[76049]:     </video>
Nov 15 11:09:58 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:09:58 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:09:58 user nova-compute[76049]:     </rng>
Nov 15 11:09:58 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:09:58 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:09:58 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:09:58 user nova-compute[76049]:     </memballoon>
Nov 15 11:09:58 user nova-compute[76049]:   </devices>
Nov 15 11:09:58 user nova-compute[76049]: </domain>
Nov 15 11:09:58 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1342677441',display_name='tempest-VolumesNegativeTest-instance-1342677441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1342677441',id=7,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ade19cfa6249d5939ab07e413a9466',ramdisk_id='',reservation_id='r-zysygraf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1965965135',owner_user_name='tempest-VolumesNegativeTest-1965965135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:53Z,user_data=None,user_id='d6cbd6f62ba045688364e0241df4fdbd',uuid=a839d9dc-b17f-421b-ac5e-6a22cffd10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Converting VIF {"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:9a,bridge_name='br-int',has_traffic_filtering=True,id=1dff976f-9c20-4915-aeca-1baac9b43a0a,network=Network(250f6248-34e4-4fb4-b4df-3aa0ccaae93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dff976f-9c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG os_vif [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:9a,bridge_name='br-int',has_traffic_filtering=True,id=1dff976f-9c20-4915-aeca-1baac9b43a0a,network=Network(250f6248-34e4-4fb4-b4df-3aa0ccaae93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dff976f-9c') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd56a8b3d-3e63-5b28-8126-31ddbb364067', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.220s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk 1073741824" returned: 0 in 0.103s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dff976f-9c, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dff976f-9c, col_values=(('qos', UUID('480ac60b-fc45-4c74-ab41-8a581626d2a3')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dff976f-9c, col_values=(('external_ids', {'iface-id': '1dff976f-9c20-4915-aeca-1baac9b43a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:86:9a', 'vm-uuid': 'a839d9dc-b17f-421b-ac5e-6a22cffd10fa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:09:58 user nova-compute[76049]: INFO os_vif [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:9a,bridge_name='br-int',has_traffic_filtering=True,id=1dff976f-9c20-4915-aeca-1baac9b43a0a,network=Network(250f6248-34e4-4fb4-b4df-3aa0ccaae93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dff976f-9c')
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] No VIF found with MAC fa:16:3e:79:86:9a, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.319s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:09:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Cannot resize image /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Ensure instance console log exists: /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Updated VIF entry in instance network info cache for port 1dff976f-9c20-4915-aeca-1baac9b43a0a. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Updating instance_info_cache with network_info: [{"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Releasing lock "refresh_cache-a839d9dc-b17f-421b-ac5e-6a22cffd10fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] No waiting events found dispatching network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:09:59 user nova-compute[76049]: WARNING nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received unexpected event network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 for instance with vm_state active and task_state None.
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] No waiting events found dispatching network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:09:59 user nova-compute[76049]: WARNING nova.compute.manager [req-25de01d0-5bd1-4378-b9cf-951d08a46e5e req-7a67015d-0aa8-493c-a166-e983e49ee20f service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received unexpected event network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be for instance with vm_state active and task_state None.
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.network.neutron [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Successfully created port: 04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:09:59 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance spawned successfully.
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:09:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:00 user nova-compute[76049]: INFO nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:10:00 user nova-compute[76049]: INFO nova.compute.manager [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Took 18.14 seconds to build instance.
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d10d3403-1cd3-4f73-9ddd-71f8f15f08ef tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.417s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] No waiting events found dispatching network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:00 user nova-compute[76049]: WARNING nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received unexpected event network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be for instance with vm_state active and task_state None.
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:00 user nova-compute[76049]: WARNING nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received unexpected event network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab for instance with vm_state active and task_state None.
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:00 user nova-compute[76049]: WARNING nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received unexpected event network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab for instance with vm_state active and task_state None.
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:00 user nova-compute[76049]: WARNING nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received unexpected event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with vm_state active and task_state None.
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:00 user nova-compute[76049]: WARNING nova.compute.manager [req-759f7c0c-b1d7-45d9-84f2-030b15c3da0a req-93dd36c9-1d37-45ed-9c7a-78680e147b91 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received unexpected event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with vm_state active and task_state None.
Nov 15 11:10:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.network.neutron [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Successfully updated port: 04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-c16eb6d1-c0f9-4f7a-b3c9-6619dfdfaa65 req-a65ee7ae-d4e5-4730-a4cb-1dc1ea3e2780 service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received event network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c16eb6d1-c0f9-4f7a-b3c9-6619dfdfaa65 req-a65ee7ae-d4e5-4730-a4cb-1dc1ea3e2780 service nova] Acquiring lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c16eb6d1-c0f9-4f7a-b3c9-6619dfdfaa65 req-a65ee7ae-d4e5-4730-a4cb-1dc1ea3e2780 service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c16eb6d1-c0f9-4f7a-b3c9-6619dfdfaa65 req-a65ee7ae-d4e5-4730-a4cb-1dc1ea3e2780 service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-c16eb6d1-c0f9-4f7a-b3c9-6619dfdfaa65 req-a65ee7ae-d4e5-4730-a4cb-1dc1ea3e2780 service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] No waiting events found dispatching network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:01 user nova-compute[76049]: WARNING nova.compute.manager [req-c16eb6d1-c0f9-4f7a-b3c9-6619dfdfaa65 req-a65ee7ae-d4e5-4730-a4cb-1dc1ea3e2780 service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received unexpected event network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a for instance with vm_state building and task_state spawning.
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquired lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.network.neutron [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-changed-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Refreshing instance network info cache due to event network-changed-04aa0913-1b50-4e1e-a854-8a97253bee1d. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] Acquiring lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.network.neutron [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.network.neutron [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Updating instance_info_cache with network_info: [{"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Releasing lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Instance network_info: |[{"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] Acquired lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Refreshing network info cache for port 04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Start _get_guest_xml network_info=[{"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:10:01 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:01 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-612735450',display_name='tempest-VolumesAssistedSnapshotsTest-server-612735450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-612735450',id=8,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNjIKNDoBux+fiIwoPFL5Fv1XrdpdJrgP25ZTbKSes2GXzF/ONIumqULnYgf83UgUmlXOXJONikTLEjzV1vby2ytNEuf4FfYIEMMBX3QJxuBCPUxyowimZMfg2QxhVsPg==',key_name='tempest-keypair-389877131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ceebd69126949f8a0522015570e74d4',ramdisk_id='',reservation_id='r-cw67v1b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-930918090',owner_user_name='tempest-VolumesAssistedSnapshotsTest-930918090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='191cae5f6c3d46209098196bdbdc429a',uuid=8a944329-f077-4be4-b780-492b9e9d978d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Converting VIF {"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:1f:9b,bridge_name='br-int',has_traffic_filtering=True,id=04aa0913-1b50-4e1e-a854-8a97253bee1d,network=Network(39d95316-719d-4a54-8e4e-462748371b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04aa0913-1b') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:01 user nova-compute[76049]: DEBUG nova.objects.instance [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a944329-f077-4be4-b780-492b9e9d978d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:10:02 user nova-compute[76049]:   <uuid>8a944329-f077-4be4-b780-492b9e9d978d</uuid>
Nov 15 11:10:02 user nova-compute[76049]:   <name>instance-00000008</name>
Nov 15 11:10:02 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:10:02 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:10:02 user nova-compute[76049]:   <metadata>
Nov 15 11:10:02 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:10:02 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:10:02 user nova-compute[76049]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-612735450</nova:name>
Nov 15 11:10:02 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:10:01</nova:creationTime>
Nov 15 11:10:02 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:10:02 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:10:02 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:10:02 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:10:02 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:10:02 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:10:02 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:10:02 user nova-compute[76049]:       <nova:owner>
Nov 15 11:10:02 user nova-compute[76049]:         <nova:user uuid="191cae5f6c3d46209098196bdbdc429a">tempest-VolumesAssistedSnapshotsTest-930918090-project-member</nova:user>
Nov 15 11:10:02 user nova-compute[76049]:         <nova:project uuid="6ceebd69126949f8a0522015570e74d4">tempest-VolumesAssistedSnapshotsTest-930918090</nova:project>
Nov 15 11:10:02 user nova-compute[76049]:       </nova:owner>
Nov 15 11:10:02 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:10:02 user nova-compute[76049]:       <nova:ports>
Nov 15 11:10:02 user nova-compute[76049]:         <nova:port uuid="04aa0913-1b50-4e1e-a854-8a97253bee1d">
Nov 15 11:10:02 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 11:10:02 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:02 user nova-compute[76049]:       </nova:ports>
Nov 15 11:10:02 user nova-compute[76049]:     </nova:instance>
Nov 15 11:10:02 user nova-compute[76049]:   </metadata>
Nov 15 11:10:02 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:10:02 user nova-compute[76049]:     <system>
Nov 15 11:10:02 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:10:02 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:10:02 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:10:02 user nova-compute[76049]:       <entry name="serial">8a944329-f077-4be4-b780-492b9e9d978d</entry>
Nov 15 11:10:02 user nova-compute[76049]:       <entry name="uuid">8a944329-f077-4be4-b780-492b9e9d978d</entry>
Nov 15 11:10:02 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:10:02 user nova-compute[76049]:     </system>
Nov 15 11:10:02 user nova-compute[76049]:   </sysinfo>
Nov 15 11:10:02 user nova-compute[76049]:   <os>
Nov 15 11:10:02 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:10:02 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:10:02 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:10:02 user nova-compute[76049]:   </os>
Nov 15 11:10:02 user nova-compute[76049]:   <features>
Nov 15 11:10:02 user nova-compute[76049]:     <acpi/>
Nov 15 11:10:02 user nova-compute[76049]:     <apic/>
Nov 15 11:10:02 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:10:02 user nova-compute[76049]:   </features>
Nov 15 11:10:02 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:10:02 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:10:02 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:10:02 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:10:02 user nova-compute[76049]:   </clock>
Nov 15 11:10:02 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:10:02 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:10:02 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:10:02 user nova-compute[76049]:   </cpu>
Nov 15 11:10:02 user nova-compute[76049]:   <devices>
Nov 15 11:10:02 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:10:02 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:10:02 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk"/>
Nov 15 11:10:02 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:10:02 user nova-compute[76049]:     </disk>
Nov 15 11:10:02 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:02 user nova-compute[76049]:       <mac address="fa:16:3e:c4:1f:9b"/>
Nov 15 11:10:02 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:02 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:02 user nova-compute[76049]:       <target dev="tap04aa0913-1b"/>
Nov 15 11:10:02 user nova-compute[76049]:     </interface>
Nov 15 11:10:02 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:10:02 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/console.log" append="off"/>
Nov 15 11:10:02 user nova-compute[76049]:     </serial>
Nov 15 11:10:02 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:10:02 user nova-compute[76049]:     <video>
Nov 15 11:10:02 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:02 user nova-compute[76049]:     </video>
Nov 15 11:10:02 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:10:02 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:10:02 user nova-compute[76049]:     </rng>
Nov 15 11:10:02 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:10:02 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:10:02 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:10:02 user nova-compute[76049]:     </memballoon>
Nov 15 11:10:02 user nova-compute[76049]:   </devices>
Nov 15 11:10:02 user nova-compute[76049]: </domain>
Nov 15 11:10:02 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-612735450',display_name='tempest-VolumesAssistedSnapshotsTest-server-612735450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-612735450',id=8,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNjIKNDoBux+fiIwoPFL5Fv1XrdpdJrgP25ZTbKSes2GXzF/ONIumqULnYgf83UgUmlXOXJONikTLEjzV1vby2ytNEuf4FfYIEMMBX3QJxuBCPUxyowimZMfg2QxhVsPg==',key_name='tempest-keypair-389877131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ceebd69126949f8a0522015570e74d4',ramdisk_id='',reservation_id='r-cw67v1b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-930918090',owner_user_name='tempest-VolumesAssistedSnapshotsTest-930918090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='191cae5f6c3d46209098196bdbdc429a',uuid=8a944329-f077-4be4-b780-492b9e9d978d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Converting VIF {"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:1f:9b,bridge_name='br-int',has_traffic_filtering=True,id=04aa0913-1b50-4e1e-a854-8a97253bee1d,network=Network(39d95316-719d-4a54-8e4e-462748371b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04aa0913-1b') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG os_vif [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:1f:9b,bridge_name='br-int',has_traffic_filtering=True,id=04aa0913-1b50-4e1e-a854-8a97253bee1d,network=Network(39d95316-719d-4a54-8e4e-462748371b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04aa0913-1b') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d63f354-5e26-5947-bc82-8da90ca9a0ef', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04aa0913-1b, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04aa0913-1b, col_values=(('qos', UUID('9caedda6-d3c4-448d-893b-34e0c6ccec57')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04aa0913-1b, col_values=(('external_ids', {'iface-id': '04aa0913-1b50-4e1e-a854-8a97253bee1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:1f:9b', 'vm-uuid': '8a944329-f077-4be4-b780-492b9e9d978d'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:02 user nova-compute[76049]: INFO os_vif [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:1f:9b,bridge_name='br-int',has_traffic_filtering=True,id=04aa0913-1b50-4e1e-a854-8a97253bee1d,network=Network(39d95316-719d-4a54-8e4e-462748371b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04aa0913-1b')
Nov 15 11:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] No VIF found with MAC fa:16:3e:c4:1f:9b, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Updated VIF entry in instance network info cache for port 04aa0913-1b50-4e1e-a854-8a97253bee1d. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Updating instance_info_cache with network_info: [{"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3b167bcb-10e1-4db8-8509-0319361368e0 req-f8c48539-77ad-4bc2-8595-0b6173b24184 service nova] Releasing lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:10:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Instance spawned successfully.
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-44c22575-50a8-437d-ac98-f5b3cf937bae req-c2141453-c7c7-4e0e-aad1-8f9d51ec79ce service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received event network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-44c22575-50a8-437d-ac98-f5b3cf937bae req-c2141453-c7c7-4e0e-aad1-8f9d51ec79ce service nova] Acquiring lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-44c22575-50a8-437d-ac98-f5b3cf937bae req-c2141453-c7c7-4e0e-aad1-8f9d51ec79ce service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-44c22575-50a8-437d-ac98-f5b3cf937bae req-c2141453-c7c7-4e0e-aad1-8f9d51ec79ce service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-44c22575-50a8-437d-ac98-f5b3cf937bae req-c2141453-c7c7-4e0e-aad1-8f9d51ec79ce service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] No waiting events found dispatching network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:03 user nova-compute[76049]: WARNING nova.compute.manager [req-44c22575-50a8-437d-ac98-f5b3cf937bae req-c2141453-c7c7-4e0e-aad1-8f9d51ec79ce service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received unexpected event network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a for instance with vm_state building and task_state spawning.
Nov 15 11:10:03 user nova-compute[76049]: INFO nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Took 10.40 seconds to spawn the instance on the hypervisor.
Nov 15 11:10:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:10:03 user nova-compute[76049]: INFO nova.compute.manager [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Took 11.44 seconds to build instance.
Nov 15 11:10:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2744086-bd4c-4100-8771-59b3937ad324 tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.795s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:10:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Instance spawned successfully.
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:06 user nova-compute[76049]: INFO nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Took 8.48 seconds to spawn the instance on the hypervisor.
Nov 15 11:10:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:10:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:06 user nova-compute[76049]: INFO nova.compute.manager [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Took 9.87 seconds to build instance.
Nov 15 11:10:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-de58b707-983a-4d35-8d93-6ee88e0abee0 tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "8a944329-f077-4be4-b780-492b9e9d978d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.155s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:10:07 user nova-compute[76049]: INFO nova.compute.claims [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Claim successful on node user
Nov 15 11:10:07 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-f1f98b2b-30f2-44ea-9043-e1ece45018de req-fa46d92f-8884-4808-9f11-c85a610e1e9f service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f1f98b2b-30f2-44ea-9043-e1ece45018de req-fa46d92f-8884-4808-9f11-c85a610e1e9f service nova] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f1f98b2b-30f2-44ea-9043-e1ece45018de req-fa46d92f-8884-4808-9f11-c85a610e1e9f service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f1f98b2b-30f2-44ea-9043-e1ece45018de req-fa46d92f-8884-4808-9f11-c85a610e1e9f service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-f1f98b2b-30f2-44ea-9043-e1ece45018de req-fa46d92f-8884-4808-9f11-c85a610e1e9f service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] No waiting events found dispatching network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:08 user nova-compute[76049]: WARNING nova.compute.manager [req-f1f98b2b-30f2-44ea-9043-e1ece45018de req-fa46d92f-8884-4808-9f11-c85a610e1e9f service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received unexpected event network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d for instance with vm_state active and task_state None.
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:10:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:10:08 user nova-compute[76049]: INFO nova.compute.claims [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Claim successful on node user
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:10:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Creating image(s)
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "/opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "/opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.policy [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39adb4a06ee64e4ab6206842b79f5e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e58ca5ef511414d9faadad3a3ad8279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "b002ac80-978b-490c-89ed-2031b850a4e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.254s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk 1073741824" returned: 0 in 0.046s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:10:08 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.422s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:10:09 user nova-compute[76049]: INFO nova.compute.claims [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Claim successful on node user
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:10:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Cannot resize image /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Ensure instance console log exists: /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:09 user nova-compute[76049]: INFO nova.virt.block_device [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Booting with volume fd09170c-4649-4362-88a2-88e036d33816 at /dev/vda
Nov 15 11:10:09 user nova-compute[76049]: DEBUG os_brick.utils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.network.neutron [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Successfully created port: 9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a215ff1-f0fc-45db-ab9b-5fd752b68024]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.policy [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c143073e9cd4d7c9ac0423a6ce2da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a967062ddbe4838a5d4fefcec26e905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efef77d-7142-4e1e-88fa-1d22f2b84f6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[92914c70-6bc7-4ffa-b9f0-487792420b0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[292cf7b3-9fb0-4b8f-ad4b-2320a7852c8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:09 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edacf1c-37d6-4437-ad00-4f1cf12ddf52]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG os_brick.utils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating existing volume attachment record: e9587a16-ffb3-420d-86b7-969e903a89c0 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:10:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:10:10 user nova-compute[76049]: INFO nova.virt.block_device [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Booting with volume e576fba2-1e9d-446d-8b8a-a2e4426dad78 at /dev/vda
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.policy [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4af6aede6c8461aaf6b2ce2545cffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642a87708964e60a9f4560bdd1ae73a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[acffd449-8a7d-4e1a-9fec-b66983f6083a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-ac5d50f9-08ba-4703-a56c-c01b9f592443 req-b2787c42-28ed-42b1-a8b7-d270d457244a service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ac5d50f9-08ba-4703-a56c-c01b9f592443 req-b2787c42-28ed-42b1-a8b7-d270d457244a service nova] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ac5d50f9-08ba-4703-a56c-c01b9f592443 req-b2787c42-28ed-42b1-a8b7-d270d457244a service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ac5d50f9-08ba-4703-a56c-c01b9f592443 req-b2787c42-28ed-42b1-a8b7-d270d457244a service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-ac5d50f9-08ba-4703-a56c-c01b9f592443 req-b2787c42-28ed-42b1-a8b7-d270d457244a service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] No waiting events found dispatching network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:10 user nova-compute[76049]: WARNING nova.compute.manager [req-ac5d50f9-08ba-4703-a56c-c01b9f592443 req-b2787c42-28ed-42b1-a8b7-d270d457244a service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received unexpected event network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d for instance with vm_state active and task_state None.
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c13c3c-192b-4c23-ad0b-63ff81844c25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d90c78-c8bc-4b08-a5f2-5db7e49eb14e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e6d5b-8376-4d34-8fcd-a83811cd7ec0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Successfully updated port: 9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:10 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9c061-1e16-43dc-b2b1-b975ad6be440]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "refresh_cache-6bce81ea-2634-40fe-945b-afe6c1e09a7c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquired lock "refresh_cache-6bce81ea-2634-40fe-945b-afe6c1e09a7c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating existing volume attachment record: 617280bf-52eb-4133-8b7a-530f11153756 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received event network-changed-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Refreshing instance network info cache due to event network-changed-9c394109-7419-49fe-9d00-9be9babcd772. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] Acquiring lock "refresh_cache-6bce81ea-2634-40fe-945b-afe6c1e09a7c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully created port: 83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Updating instance_info_cache with network_info: [{"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Releasing lock "refresh_cache-6bce81ea-2634-40fe-945b-afe6c1e09a7c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Instance network_info: |[{"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] Acquired lock "refresh_cache-6bce81ea-2634-40fe-945b-afe6c1e09a7c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.network.neutron [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Refreshing network info cache for port 9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Start _get_guest_xml network_info=[{"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:10:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully created port: 628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-725854971',display_name='tempest-VolumesActionsTest-instance-725854971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-725854971',id=9,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e58ca5ef511414d9faadad3a3ad8279',ramdisk_id='',reservation_id='r-eg3u8kbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1276343229',owner_user_name='tempest-VolumesActionsTest-1276343229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:08Z,user_data=None,user_id='39adb4a06ee64e4ab6206842b79f5e51',uuid=6bce81ea-2634-40fe-945b-afe6c1e09a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converting VIF {"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:be:13,bridge_name='br-int',has_traffic_filtering=True,id=9c394109-7419-49fe-9d00-9be9babcd772,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c394109-74') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.objects.instance [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bce81ea-2634-40fe-945b-afe6c1e09a7c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:10:11 user nova-compute[76049]:   <uuid>6bce81ea-2634-40fe-945b-afe6c1e09a7c</uuid>
Nov 15 11:10:11 user nova-compute[76049]:   <name>instance-00000009</name>
Nov 15 11:10:11 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:10:11 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:10:11 user nova-compute[76049]:   <metadata>
Nov 15 11:10:11 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:10:11 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:10:11 user nova-compute[76049]:       <nova:name>tempest-VolumesActionsTest-instance-725854971</nova:name>
Nov 15 11:10:11 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:10:10</nova:creationTime>
Nov 15 11:10:11 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:10:11 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:10:11 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:10:11 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:10:11 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:10:11 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:10:11 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:10:11 user nova-compute[76049]:       <nova:owner>
Nov 15 11:10:11 user nova-compute[76049]:         <nova:user uuid="39adb4a06ee64e4ab6206842b79f5e51">tempest-VolumesActionsTest-1276343229-project-member</nova:user>
Nov 15 11:10:11 user nova-compute[76049]:         <nova:project uuid="5e58ca5ef511414d9faadad3a3ad8279">tempest-VolumesActionsTest-1276343229</nova:project>
Nov 15 11:10:11 user nova-compute[76049]:       </nova:owner>
Nov 15 11:10:11 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:10:11 user nova-compute[76049]:       <nova:ports>
Nov 15 11:10:11 user nova-compute[76049]:         <nova:port uuid="9c394109-7419-49fe-9d00-9be9babcd772">
Nov 15 11:10:11 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 11:10:11 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:11 user nova-compute[76049]:       </nova:ports>
Nov 15 11:10:11 user nova-compute[76049]:     </nova:instance>
Nov 15 11:10:11 user nova-compute[76049]:   </metadata>
Nov 15 11:10:11 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:10:11 user nova-compute[76049]:     <system>
Nov 15 11:10:11 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:10:11 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:10:11 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:10:11 user nova-compute[76049]:       <entry name="serial">6bce81ea-2634-40fe-945b-afe6c1e09a7c</entry>
Nov 15 11:10:11 user nova-compute[76049]:       <entry name="uuid">6bce81ea-2634-40fe-945b-afe6c1e09a7c</entry>
Nov 15 11:10:11 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:10:11 user nova-compute[76049]:     </system>
Nov 15 11:10:11 user nova-compute[76049]:   </sysinfo>
Nov 15 11:10:11 user nova-compute[76049]:   <os>
Nov 15 11:10:11 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:10:11 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:10:11 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:10:11 user nova-compute[76049]:   </os>
Nov 15 11:10:11 user nova-compute[76049]:   <features>
Nov 15 11:10:11 user nova-compute[76049]:     <acpi/>
Nov 15 11:10:11 user nova-compute[76049]:     <apic/>
Nov 15 11:10:11 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:10:11 user nova-compute[76049]:   </features>
Nov 15 11:10:11 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:10:11 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:10:11 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:10:11 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:10:11 user nova-compute[76049]:   </clock>
Nov 15 11:10:11 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:10:11 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:10:11 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:10:11 user nova-compute[76049]:   </cpu>
Nov 15 11:10:11 user nova-compute[76049]:   <devices>
Nov 15 11:10:11 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:10:11 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:10:11 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk"/>
Nov 15 11:10:11 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:10:11 user nova-compute[76049]:     </disk>
Nov 15 11:10:11 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:11 user nova-compute[76049]:       <mac address="fa:16:3e:50:be:13"/>
Nov 15 11:10:11 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:11 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:11 user nova-compute[76049]:       <target dev="tap9c394109-74"/>
Nov 15 11:10:11 user nova-compute[76049]:     </interface>
Nov 15 11:10:11 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:10:11 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/console.log" append="off"/>
Nov 15 11:10:11 user nova-compute[76049]:     </serial>
Nov 15 11:10:11 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:10:11 user nova-compute[76049]:     <video>
Nov 15 11:10:11 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:11 user nova-compute[76049]:     </video>
Nov 15 11:10:11 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:10:11 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:10:11 user nova-compute[76049]:     </rng>
Nov 15 11:10:11 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:10:11 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:10:11 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:10:11 user nova-compute[76049]:     </memballoon>
Nov 15 11:10:11 user nova-compute[76049]:   </devices>
Nov 15 11:10:11 user nova-compute[76049]: </domain>
Nov 15 11:10:11 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-725854971',display_name='tempest-VolumesActionsTest-instance-725854971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-725854971',id=9,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e58ca5ef511414d9faadad3a3ad8279',ramdisk_id='',reservation_id='r-eg3u8kbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1276343229',owner_user_name='tempest-VolumesActionsTest-1276343229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:08Z,user_data=None,user_id='39adb4a06ee64e4ab6206842b79f5e51',uuid=6bce81ea-2634-40fe-945b-afe6c1e09a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converting VIF {"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:be:13,bridge_name='br-int',has_traffic_filtering=True,id=9c394109-7419-49fe-9d00-9be9babcd772,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c394109-74') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG os_vif [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:be:13,bridge_name='br-int',has_traffic_filtering=True,id=9c394109-7419-49fe-9d00-9be9babcd772,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c394109-74') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f67aff1a-e5d2-5b3c-86cf-08c29a73090f', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c394109-74, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c394109-74, col_values=(('qos', UUID('ad8abe86-19c6-4655-9ed5-c3c4d0664951')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c394109-74, col_values=(('external_ids', {'iface-id': '9c394109-7419-49fe-9d00-9be9babcd772', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:be:13', 'vm-uuid': '6bce81ea-2634-40fe-945b-afe6c1e09a7c'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:11 user nova-compute[76049]: INFO os_vif [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:be:13,bridge_name='br-int',has_traffic_filtering=True,id=9c394109-7419-49fe-9d00-9be9babcd772,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c394109-74')
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully created port: 9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] No VIF found with MAC fa:16:3e:50:be:13, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Updated VIF entry in instance network info cache for port 9c394109-7419-49fe-9d00-9be9babcd772. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Updating instance_info_cache with network_info: [{"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully created port: 0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ce2c4d23-6e4d-499f-830a-486fff383d59 req-776eb32f-2a91-436f-823d-0fe10b30d9fd service nova] Releasing lock "refresh_cache-6bce81ea-2634-40fe-945b-afe6c1e09a7c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully created port: 4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully created port: 81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Skipping network cache update for instance because it is Building. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Skipping network cache update for instance because it is Building. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Skipping network cache update for instance because it is Building. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully created port: fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 4688fd69-68cc-4345-b191-9d92c2e9456a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updating instance_info_cache with network_info: [{"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully created port: 9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-4688fd69-68cc-4345-b191-9d92c2e9456a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-a574b92e-bcd4-4846-9708-14e8b47d8850 req-f18d1500-8ed4-4beb-bf58-3636eed28e35 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received event network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a574b92e-bcd4-4846-9708-14e8b47d8850 req-f18d1500-8ed4-4beb-bf58-3636eed28e35 service nova] Acquiring lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a574b92e-bcd4-4846-9708-14e8b47d8850 req-f18d1500-8ed4-4beb-bf58-3636eed28e35 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a574b92e-bcd4-4846-9708-14e8b47d8850 req-f18d1500-8ed4-4beb-bf58-3636eed28e35 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-a574b92e-bcd4-4846-9708-14e8b47d8850 req-f18d1500-8ed4-4beb-bf58-3636eed28e35 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] No waiting events found dispatching network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:13 user nova-compute[76049]: WARNING nova.compute.manager [req-a574b92e-bcd4-4846-9708-14e8b47d8850 req-f18d1500-8ed4-4beb-bf58-3636eed28e35 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received unexpected event network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 for instance with vm_state building and task_state spawning.
Nov 15 11:10:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:13 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully created port: 043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully created port: 4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:14 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:10:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully updated port: 83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully updated port: 628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-628847f4-3e6e-4afa-821c-7d9869e65909. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully updated port: b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:10:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Instance spawned successfully.
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received event network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Acquiring lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] No waiting events found dispatching network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:15 user nova-compute[76049]: WARNING nova.compute.manager [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received unexpected event network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 for instance with vm_state building and task_state spawning.
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-83e89ce0-ade3-4004-9479-ab4c18968959. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port 83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:15 user nova-compute[76049]: INFO nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Took 7.50 seconds to spawn the instance on the hypervisor.
Nov 15 11:10:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:16 user nova-compute[76049]: INFO nova.compute.manager [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Took 8.61 seconds to build instance.
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-482d48ec-c7a1-48d4-accb-7a3daaa618e8 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.778s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully updated port: 72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-835b1d56-4461-4d9d-adac-486e5d809d32 req-47b0e8f1-b6f3-444b-aaaf-873682ed49d6 service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-b3ffb2ec-11af-45de-a8dc-71263904b4ad. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:16 user nova-compute[76049]: INFO nova.virt.block_device [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Booting with volume 514b6e32-3f20-4112-b907-2a59703fcb32 at /dev/vdb
Nov 15 11:10:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully updated port: 54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG os_brick.utils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde5adf-c4a4-4aa1-9cf0-428657e3c92f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8448da0d-d63e-4ec6-a43f-03931b277222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe8938c-2395-43c3-b037-1c0fdd8ba273]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d309f86b-7896-466f-9fe2-a22e4f4ef364]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:17 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f6949f-9002-4c95-85e7-dedd2de21de9]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG os_brick.utils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating existing volume attachment record: de52b9c2-f7f2-487b-8d34-1a800e98bb34 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-938bc758-bd75-4e6e-b786-c9fcc7ed53df req-eb9cdadb-31a0-4590-b50d-33ab11146402 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully updated port: 4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-72a2ff38-f9ff-4207-acee-f4aae1916935. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully updated port: 0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-4e410728-06eb-4513-8b9f-2a3c93c8af1e. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port 4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully updated port: 9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-54f92c53-94cb-4593-929e-0040324c8400. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully updated port: 81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0e2ac67d-e7d5-4e30-a914-fd18a33a1947 req-92944df8-1d64-49be-91ee-42f9aa862d77 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9e3ce0f-b8c8-478c-a3e6-5b63b94f021c req-e41a59fa-67cd-4827-b82c-040e58392c5d service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully updated port: 4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-4cc0cf5e-e34a-489e-86bf-0055280695d7. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port 4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully updated port: 9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d0ae653b-1104-4116-a1bc-c3e1bf4e3a62 req-748915c6-af28-439f-8904-bd2570424510 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:19 user nova-compute[76049]: INFO nova.virt.block_device [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Booting with volume 6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 at /dev/vdb
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG os_brick.utils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully updated port: fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b1718-b953-45eb-a760-1ff68c421b76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[492b84e6-f92f-4204-9921-f5a3083ea572]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4686b4-c424-4323-8daa-96905f8c4e5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfcdb25-b4ec-4398-bf4f-6cf309867f4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-0962aed1-0769-49b5-beff-b100e4efca61. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:19 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d82652-c7ce-4f67-a0d5-97ae0eda7e7e]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG os_brick.utils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating existing volume attachment record: 36223ec8-3a2a-4740-9824-71a44806fb9f {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Successfully updated port: 4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-9e2778b2-2e82-437e-9b8c-64cba0c7165b. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port 9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-81a358fb-5ab5-4f2b-8551-b5db194907ed. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Successfully updated port: 043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f1e22f64-569a-4dd4-8ffa-2e7748f4120f req-3b9dc23b-951a-40bc-8bd1-627280945502 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-9d25524e-f12f-45cc-9d48-4f38593b6787. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7341MB free_disk=25.718494415283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.network.neutron [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f7851c09-961e-466c-878a-df770c86b5f0 req-55becb30-e1ac-42e1-9629-7d4da8f8365b service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4688fd69-68cc-4345-b191-9d92c2e9456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d23b5032-89df-47d6-93fa-496bd3d5671c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance cc582aae-00f7-4c3d-b551-a70aac92d7ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a920e6ce-95d2-445c-b485-548da3d81042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c14698a2-4375-4eff-b590-da9bd6b705c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a839d9dc-b17f-421b-ac5e-6a22cffd10fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8a944329-f077-4be4-b780-492b9e9d978d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6bce81ea-2634-40fe-945b-afe6c1e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 84391b07-a2b0-4053-b6d5-3d9912dcb7aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b002ac80-978b-490c-89ed-2031b850a4e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-4c5b9995-c31f-4d2b-8426-654e16b213bd. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:10:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:10:22 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:10:22 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:10:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:10:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.253s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:22 user nova-compute[76049]: INFO nova.virt.block_device [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Booting with volume e2ae238b-36d7-4bff-a905-8c511040ee11 at /dev/vdc
Nov 15 11:10:23 user nova-compute[76049]: DEBUG os_brick.utils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83960c-52ad-4f41-a88d-e5a075c8d5b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a98e3-bf34-44f3-b720-03cc1185b959]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b30c27-477e-4acf-b937-48e709e836d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588f95c-107c-4256-ad05-ffc61349fc75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:23 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f80ed9f-d012-43f8-9fcc-43a7d705201f]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG os_brick.utils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating existing volume attachment record: 9ae4d385-fba9-41d9-88f6-3fc071c7ecb7 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [{"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance network_info: |[{"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [{"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance network_info: |[{"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updated VIF entry in instance network info cache for port fec0748e-c7bd-47b4-a5e8-bf4d14ad959b. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [{"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-043cd6d1-7987-4ea2-921d-28568431277d. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port 043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updated VIF entry in instance network info cache for port 4c5b9995-c31f-4d2b-8426-654e16b213bd. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:10:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [{"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e20e284-4be8-46d8-9912-e4b094783dce req-29427d6a-1d56-4a63-abee-45e3fa74c535 service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updated VIF entry in instance network info cache for port 043cd6d1-7987-4ea2-921d-28568431277d. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:10:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [{"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e3d2fba7-969f-4880-94eb-afd5b8e497ef req-55276c38-9f68-465e-bf35-cdf2d3dbaad4 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:25 user nova-compute[76049]: INFO nova.virt.block_device [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Booting with volume 80851a8b-1f60-4d35-8e35-d226f3fef722 at /dev/vdc
Nov 15 11:10:25 user nova-compute[76049]: DEBUG os_brick.utils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[da71ce74-23a6-453a-8932-5a793624d99d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a5a15-aaf3-4111-9376-7eba9d97b42a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6771be5-9890-436a-b240-871d69519a6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f482008e-ba66-41ef-b428-40375e0cd289]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:10:25 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:10:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e549815a-830b-41b4-bf30-30312d4b0e41]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG os_brick.utils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:25 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating existing volume attachment record: 11fd4577-455e-41a7-82e9-75306042f10a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:10:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:10:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Creating image(s)
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Ensure instance console log exists: /opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Start _get_guest_xml network_info=[{"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwYOMBIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b002ac80-978b-490c-89ed-2031b850a4e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e576fba2-1e9d-446d-8b8a-a2e4426dad78', 'serial': 'e576fba2-1e9d-446d-8b8a-a2e4426dad78'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '617280bf-52eb-4133-8b7a-530f11153756', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIyUKlEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b002ac80-978b-490c-89ed-2031b850a4e1', 'attached_at': '', 'detached_at': '', 'volume_id': '514b6e32-3f20-4112-b907-2a59703fcb32', 'serial': '514b6e32-3f20-4112-b907-2a59703fcb32'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': 'de52b9c2-f7f2-487b-8d34-1a800e98bb34', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgImGxtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b002ac80-978b-490c-89ed-2031b850a4e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2ae238b-36d7-4bff-a905-8c511040ee11', 'serial': 'e2ae238b-36d7-4bff-a905-8c511040ee11'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '9ae4d385-fba9-41d9-88f6-3fc071c7ecb7', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:10:28 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:28 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwYOMBIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:28 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:28 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:28 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:10:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a35bbdd-4c74-4e7a-a768-b6b5d21784ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:10:28 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9480e015-341c-40e3-a9bf-cefea894dc84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78] added
Nov 15 11:10:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbce5c20-679b-41a2-8e0f-568f1b61e490]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88abde7-ac61-4359-8f11-dfcb24a7ed15]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwYOMBIX {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwYOMBIX" returned: 0 in 0.049s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[05835948-a2a7-4121-b7eb-f18f46da8ce4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zwYOMBIX'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e011b-0e1d-478b-836f-b966cc404f55]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c95567-fddc-414c-8356-1e887be620d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb821f7-88d4-449a-b515-4244f0709030]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260]
Nov 15 11:10:29 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260] successful.
Nov 15 11:10:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c80542-d70c-4bbc-aeb5-77d73de022c7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[74762b18-9e2c-4e85-a3b6-6fa4cf7af53a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:29 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:29 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4880ad-cde9-4820-be0c-79e2630e4718]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:10:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwYOMBIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23162376536626365', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162376536626365', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIyUKlEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:30 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:30 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:30 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace87cc-208a-44ea-b951-0eb933a7730d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:10:30 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfeee15-c0ac-4726-b5c0-ee6ee8cb7e66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32] added
Nov 15 11:10:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c475063-0271-4809-b04a-b5ef78d2a058]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8772dd5-43ae-4e79-962d-b1c89de1f097]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIyUKlEC {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIyUKlEC" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[df006a89-320b-4cc6-b552-2283d6a9504b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PIyUKlEC'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90f2436-d77e-4d40-9c11-43ae1a7158b4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5220428-6de3-499b-9c35-efe5664d306e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:30 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:30 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4120d77f-99e1-4dbc-ac87-47d40c987858]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260]
Nov 15 11:10:30 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260] successful.
Nov 15 11:10:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a94188-fe7a-4648-8c4b-38573fbe231f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72e1a2a-a044-4abd-ae03-e8e1bd42d277]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:30 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:30 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:30 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:30 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cb619c-30a6-45dc-8a4c-32eacb4937fa]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:10:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIyUKlEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:10:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Creating image(s)
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Ensure instance console log exists: /opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Start _get_guest_xml network_info=[{"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpMtnFEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd09170c-4649-4362-88a2-88e036d33816', 'serial': 'fd09170c-4649-4362-88a2-88e036d33816'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'e9587a16-ffb3-420d-86b7-969e903a89c0', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJAQvZHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa', 'attached_at': '', 'detached_at': '', 'volume_id': '6a6afb24-dfc4-4ce6-9028-663fd8afa3d2', 'serial': '6a6afb24-dfc4-4ce6-9028-663fd8afa3d2'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '36223ec8-3a2a-4740-9824-71a44806fb9f', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjQlTgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa', 'attached_at': '', 'detached_at': '', 'volume_id': '80851a8b-1f60-4d35-8e35-d226f3fef722', 'serial': '80851a8b-1f60-4d35-8e35-d226f3fef722'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '11fd4577-455e-41a7-82e9-75306042f10a', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:10:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpMtnFEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26362323738386638', 'path': '/dev/sdd'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362323738386638', 'path': '/dev/sdd'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.351s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:31 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fe82d-5dfe-49e9-a371-311aff08582d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:10:31 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgImGxtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffaf9a8-1223-4c05-bc1a-59199cd5a5be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816] added
Nov 15 11:10:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a364e4b4-d55c-4fad-b14b-5e3f83fdf527]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b4f8d-667b-4b0e-8782-0e7cf6e355fb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YpMtnFEh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YpMtnFEh" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf3464d-c534-4296-9fe3-1eae6fc02f42]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YpMtnFEh'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5cc5d-4b57-42f3-850e-98472e2cecd1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e8378b-a078-43bb-a7d8-7102e3b08b5a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c807a6-4fb3-4ee5-88be-2f9939291dce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260]
Nov 15 11:10:31 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260] successful.
Nov 15 11:10:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f68af8-82f8-49aa-bbf9-f102b0322719]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0860c9f2-9fec-48e2-a16f-849573dcff4b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:10:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c279189-042a-48de-9cea-e99a31e81a63]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:10:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpMtnFEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== connect_volume: return (1658ms) {'type': 'block', 'scsi_wwn': '26133356166333966', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133356166333966', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.278s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:33 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:33 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJAQvZHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:33 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbefbe1b-0958-4e19-8909-fc69d5a4eccf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:10:33 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa2dc32-c6e2-4d10-bd8d-96725fc188ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11] added
Nov 15 11:10:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b49a496-85bf-41bd-b0ff-46fb556891ac]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[297ef56b-0f1d-49b3-ba9a-8745ca335347]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgImGxtb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgImGxtb" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2929814a-7e25-4799-a476-1074ed996753]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgImGxtb'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd9387-4771-439c-8939-9e8a27737391]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a25ccad-093c-42d8-8569-fe6fe2a1ee2c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3dd380-6505-4b86-b147-ae66173af2ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260]
Nov 15 11:10:33 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260] successful.
Nov 15 11:10:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba3bfff-8b9a-4431-8ed5-741b47f08a50]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f4c8c6-f633-472d-8e8b-a04d3dc06c14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f363ecd-856f-426a-a039-0a23312bde61]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:10:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgImGxtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== connect_volume: return (2630ms) {'type': 'block', 'scsi_wwn': '23835393935626161', 'path': '/dev/sdf'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835393935626161', 'path': '/dev/sdf'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.328s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:34 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:34 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[521152d9-d87e-47a8-a191-4f4c0ecb0efa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:10:34 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=628847f4-3e6e-4afa-821c-7d9869e65909,network=Network(4fa5e679-abd5-4829-8971-c23eb99232a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628847f4-3e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:62:e0,bridge_name='br-int',has_traffic_filtering=True,id=72a2ff38-f9ff-4207-acee-f4aae1916935,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72a2ff38-f9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=54f92c53-94cb-4593-929e-0040324c8400,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54f92c53-94') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:88:82,bridge_name='br-int',has_traffic_filtering=True,id=0962aed1-0769-49b5-beff-b100e4efca61,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0962aed1-07') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:0d:7f,bridge_name='br-int',has_traffic_filtering=True,id=81a358fb-5ab5-4f2b-8551-b5db194907ed,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a358fb-5a') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:ec,bridge_name='br-int',has_traffic_filtering=True,id=9d25524e-f12f-45cc-9d48-4f38593b6787,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d25524e-f1') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:26:a7,bridge_name='br-int',has_traffic_filtering=True,id=4c5b9995-c31f-4d2b-8426-654e16b213bd,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5b9995-c3') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lazy-loading 'pci_devices' on Instance uuid b002ac80-978b-490c-89ed-2031b850a4e1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dc5d0-bac2-462d-af08-1a7652468024]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2] added
Nov 15 11:10:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:10:34 user nova-compute[76049]:   <uuid>b002ac80-978b-490c-89ed-2031b850a4e1</uuid>
Nov 15 11:10:34 user nova-compute[76049]:   <name>instance-0000000b</name>
Nov 15 11:10:34 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:10:34 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:10:34 user nova-compute[76049]:   <metadata>
Nov 15 11:10:34 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:10:34 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:10:34 user nova-compute[76049]:       <nova:name>tempest-device-tagging-server-1861293053</nova:name>
Nov 15 11:10:34 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:10:28</nova:creationTime>
Nov 15 11:10:34 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:10:34 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:10:34 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:10:34 user nova-compute[76049]:       <nova:owner>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:user uuid="d4af6aede6c8461aaf6b2ce2545cffc2">tempest-TaggedBootDevicesTest-495262631-project-member</nova:user>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:project uuid="2642a87708964e60a9f4560bdd1ae73a">tempest-TaggedBootDevicesTest-495262631</nova:project>
Nov 15 11:10:34 user nova-compute[76049]:       </nova:owner>
Nov 15 11:10:34 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:10:34 user nova-compute[76049]:       <nova:ports>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:port uuid="628847f4-3e6e-4afa-821c-7d9869e65909">
Nov 15 11:10:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 11:10:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:port uuid="72a2ff38-f9ff-4207-acee-f4aae1916935">
Nov 15 11:10:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Nov 15 11:10:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:port uuid="54f92c53-94cb-4593-929e-0040324c8400">
Nov 15 11:10:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.232" ipVersion="4"/>
Nov 15 11:10:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:port uuid="0962aed1-0769-49b5-beff-b100e4efca61">
Nov 15 11:10:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.29" ipVersion="4"/>
Nov 15 11:10:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:port uuid="81a358fb-5ab5-4f2b-8551-b5db194907ed">
Nov 15 11:10:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Nov 15 11:10:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:port uuid="9d25524e-f12f-45cc-9d48-4f38593b6787">
Nov 15 11:10:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 11:10:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:34 user nova-compute[76049]:         <nova:port uuid="4c5b9995-c31f-4d2b-8426-654e16b213bd">
Nov 15 11:10:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 11:10:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:34 user nova-compute[76049]:       </nova:ports>
Nov 15 11:10:34 user nova-compute[76049]:     </nova:instance>
Nov 15 11:10:34 user nova-compute[76049]:   </metadata>
Nov 15 11:10:34 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:10:34 user nova-compute[76049]:     <system>
Nov 15 11:10:34 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:10:34 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:10:34 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:10:34 user nova-compute[76049]:       <entry name="serial">b002ac80-978b-490c-89ed-2031b850a4e1</entry>
Nov 15 11:10:34 user nova-compute[76049]:       <entry name="uuid">b002ac80-978b-490c-89ed-2031b850a4e1</entry>
Nov 15 11:10:34 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:10:34 user nova-compute[76049]:     </system>
Nov 15 11:10:34 user nova-compute[76049]:   </sysinfo>
Nov 15 11:10:34 user nova-compute[76049]:   <os>
Nov 15 11:10:34 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:10:34 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:10:34 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:10:34 user nova-compute[76049]:   </os>
Nov 15 11:10:34 user nova-compute[76049]:   <features>
Nov 15 11:10:34 user nova-compute[76049]:     <acpi/>
Nov 15 11:10:34 user nova-compute[76049]:     <apic/>
Nov 15 11:10:34 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:10:34 user nova-compute[76049]:   </features>
Nov 15 11:10:34 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:10:34 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:10:34 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:10:34 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:10:34 user nova-compute[76049]:   </clock>
Nov 15 11:10:34 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:10:34 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:10:34 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:10:34 user nova-compute[76049]:   </cpu>
Nov 15 11:10:34 user nova-compute[76049]:   <devices>
Nov 15 11:10:34 user nova-compute[76049]:     <disk type="file" device="cdrom">
Nov 15 11:10:34 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 11:10:34 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1/disk.config"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="hda" bus="ide"/>
Nov 15 11:10:34 user nova-compute[76049]:     </disk>
Nov 15 11:10:34 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:10:34 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:10:34 user nova-compute[76049]:       <source dev="/dev/sdc"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <serial>e576fba2-1e9d-446d-8b8a-a2e4426dad78</serial>
Nov 15 11:10:34 user nova-compute[76049]:     </disk>
Nov 15 11:10:34 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:10:34 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:10:34 user nova-compute[76049]:       <source dev="/dev/sdd"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <serial>514b6e32-3f20-4112-b907-2a59703fcb32</serial>
Nov 15 11:10:34 user nova-compute[76049]:     </disk>
Nov 15 11:10:34 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:10:34 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:10:34 user nova-compute[76049]:       <source dev="/dev/sdf"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="vdc" bus="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <serial>e2ae238b-36d7-4bff-a905-8c511040ee11</serial>
Nov 15 11:10:34 user nova-compute[76049]:     </disk>
Nov 15 11:10:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:34 user nova-compute[76049]:       <mac address="fa:16:3e:af:1c:62"/>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="tap628847f4-3e"/>
Nov 15 11:10:34 user nova-compute[76049]:     </interface>
Nov 15 11:10:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:34 user nova-compute[76049]:       <mac address="fa:16:3e:21:62:e0"/>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="tap72a2ff38-f9"/>
Nov 15 11:10:34 user nova-compute[76049]:     </interface>
Nov 15 11:10:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:34 user nova-compute[76049]:       <mac address="fa:16:3e:62:3b:0c"/>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="tap54f92c53-94"/>
Nov 15 11:10:34 user nova-compute[76049]:     </interface>
Nov 15 11:10:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:34 user nova-compute[76049]:       <mac address="fa:16:3e:ba:88:82"/>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="tap0962aed1-07"/>
Nov 15 11:10:34 user nova-compute[76049]:     </interface>
Nov 15 11:10:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:34 user nova-compute[76049]:       <mac address="fa:16:3e:00:0d:7f"/>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="tap81a358fb-5a"/>
Nov 15 11:10:34 user nova-compute[76049]:     </interface>
Nov 15 11:10:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:34 user nova-compute[76049]:       <mac address="fa:16:3e:5c:af:ec"/>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="tap9d25524e-f1"/>
Nov 15 11:10:34 user nova-compute[76049]:     </interface>
Nov 15 11:10:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:34 user nova-compute[76049]:       <mac address="fa:16:3e:60:26:a7"/>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:34 user nova-compute[76049]:       <target dev="tap4c5b9995-c3"/>
Nov 15 11:10:34 user nova-compute[76049]:     </interface>
Nov 15 11:10:34 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:10:34 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1/console.log" append="off"/>
Nov 15 11:10:34 user nova-compute[76049]:     </serial>
Nov 15 11:10:34 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:10:34 user nova-compute[76049]:     <video>
Nov 15 11:10:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:34 user nova-compute[76049]:     </video>
Nov 15 11:10:34 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:10:34 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:10:34 user nova-compute[76049]:     </rng>
Nov 15 11:10:34 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:10:34 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:10:34 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:10:34 user nova-compute[76049]:     </memballoon>
Nov 15 11:10:34 user nova-compute[76049]:   </devices>
Nov 15 11:10:34 user nova-compute[76049]: </domain>
Nov 15 11:10:34 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=628847f4-3e6e-4afa-821c-7d9869e65909,network=Network(4fa5e679-abd5-4829-8971-c23eb99232a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628847f4-3e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=628847f4-3e6e-4afa-821c-7d9869e65909,network=Network(4fa5e679-abd5-4829-8971-c23eb99232a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628847f4-3e') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61074a41-285c-5748-9209-dd51ba668f0a', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a087d15b-5da9-4f42-98b1-a460cdba8a58]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap628847f4-3e, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap628847f4-3e, col_values=(('qos', UUID('40d24d62-4bd4-4ad1-84bb-243072bbec11')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap628847f4-3e, col_values=(('external_ids', {'iface-id': '628847f4-3e6e-4afa-821c-7d9869e65909', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:1c:62', 'vm-uuid': 'b002ac80-978b-490c-89ed-2031b850a4e1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba00fe00-9db0-4d48-a747-b810fa878849]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJAQvZHX {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: INFO os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=628847f4-3e6e-4afa-821c-7d9869e65909,network=Network(4fa5e679-abd5-4829-8971-c23eb99232a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628847f4-3e')
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:62:e0,bridge_name='br-int',has_traffic_filtering=True,id=72a2ff38-f9ff-4207-acee-f4aae1916935,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72a2ff38-f9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:62:e0,bridge_name='br-int',has_traffic_filtering=True,id=72a2ff38-f9ff-4207-acee-f4aae1916935,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72a2ff38-f9') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '508ed1e7-4451-5355-b228-b319c1d35c9e', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJAQvZHX" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58ee076-9d11-4a65-9b75-0bb2d88d513e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wJAQvZHX'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a2ff38-f9, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72a2ff38-f9, col_values=(('qos', UUID('387417f3-16c9-46d7-a08c-5173915690b7')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72a2ff38-f9, col_values=(('external_ids', {'iface-id': '72a2ff38-f9ff-4207-acee-f4aae1916935', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:62:e0', 'vm-uuid': 'b002ac80-978b-490c-89ed-2031b850a4e1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8309dfc2-428d-439e-8fa5-d7550ab7887e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: INFO os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:62:e0,bridge_name='br-int',has_traffic_filtering=True,id=72a2ff38-f9ff-4207-acee-f4aae1916935,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72a2ff38-f9')
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=54f92c53-94cb-4593-929e-0040324c8400,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54f92c53-94') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=54f92c53-94cb-4593-929e-0040324c8400,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54f92c53-94') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c465501-4bd1-5599-8c29-cb139f81143d', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f483b06d-6de1-412f-b5fd-3f1a926b6668]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54f92c53-94, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54f92c53-94, col_values=(('qos', UUID('27513c0c-11bf-48a7-ab2c-421f49707aa9')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54f92c53-94, col_values=(('external_ids', {'iface-id': '54f92c53-94cb-4593-929e-0040324c8400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:3b:0c', 'vm-uuid': 'b002ac80-978b-490c-89ed-2031b850a4e1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: INFO os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=54f92c53-94cb-4593-929e-0040324c8400,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54f92c53-94')
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:88:82,bridge_name='br-int',has_traffic_filtering=True,id=0962aed1-0769-49b5-beff-b100e4efca61,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0962aed1-07') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:88:82,bridge_name='br-int',has_traffic_filtering=True,id=0962aed1-0769-49b5-beff-b100e4efca61,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0962aed1-07') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23daa4fe-50ea-5f73-a9a2-43888681ca69', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b4eab-734a-436d-be38-5f23f45fa7ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260]
Nov 15 11:10:34 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260] successful.
Nov 15 11:10:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0962aed1-07, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0962aed1-07, col_values=(('qos', UUID('3b0ede16-bad4-4579-9d92-9f14e3215ccc')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0962aed1-07, col_values=(('external_ids', {'iface-id': '0962aed1-0769-49b5-beff-b100e4efca61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:88:82', 'vm-uuid': 'b002ac80-978b-490c-89ed-2031b850a4e1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[56070042-01f3-4fcb-a4e0-203e951b5a4a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1235b8d-f979-47e0-a4ef-c2518c4fa916]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:10:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: INFO os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:88:82,bridge_name='br-int',has_traffic_filtering=True,id=0962aed1-0769-49b5-beff-b100e4efca61,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0962aed1-07')
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:0d:7f,bridge_name='br-int',has_traffic_filtering=True,id=81a358fb-5ab5-4f2b-8551-b5db194907ed,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a358fb-5a') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0d:7f,bridge_name='br-int',has_traffic_filtering=True,id=81a358fb-5ab5-4f2b-8551-b5db194907ed,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a358fb-5a') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51c7142d-7ec7-51ed-a036-80a79e855f61', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f317cc-a698-4c3e-8dc6-0d8093eb0118]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJAQvZHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81a358fb-5a, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81a358fb-5a, col_values=(('qos', UUID('6dc3c956-6eb9-4c3d-9575-f047306ffdcb')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81a358fb-5a, col_values=(('external_ids', {'iface-id': '81a358fb-5ab5-4f2b-8551-b5db194907ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:0d:7f', 'vm-uuid': 'b002ac80-978b-490c-89ed-2031b850a4e1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: INFO os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0d:7f,bridge_name='br-int',has_traffic_filtering=True,id=81a358fb-5ab5-4f2b-8551-b5db194907ed,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a358fb-5a')
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:ec,bridge_name='br-int',has_traffic_filtering=True,id=9d25524e-f12f-45cc-9d48-4f38593b6787,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d25524e-f1') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:ec,bridge_name='br-int',has_traffic_filtering=True,id=9d25524e-f12f-45cc-9d48-4f38593b6787,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d25524e-f1') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7b6dd9c-519f-5261-b4ff-17427c47cf8f', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d25524e-f1, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d25524e-f1, col_values=(('qos', UUID('78a07a3c-291a-4f97-bafe-070fcc80d260')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d25524e-f1, col_values=(('external_ids', {'iface-id': '9d25524e-f12f-45cc-9d48-4f38593b6787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:af:ec', 'vm-uuid': 'b002ac80-978b-490c-89ed-2031b850a4e1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: INFO os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:ec,bridge_name='br-int',has_traffic_filtering=True,id=9d25524e-f12f-45cc-9d48-4f38593b6787,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d25524e-f1')
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:26:a7,bridge_name='br-int',has_traffic_filtering=True,id=4c5b9995-c31f-4d2b-8426-654e16b213bd,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5b9995-c3') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:26:a7,bridge_name='br-int',has_traffic_filtering=True,id=4c5b9995-c31f-4d2b-8426-654e16b213bd,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5b9995-c3') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6dbe3b1-bd7b-5a9d-aec1-89fc01a43121', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c5b9995-c3, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c5b9995-c3, col_values=(('qos', UUID('f98580bc-de54-4266-a651-503e6af09774')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c5b9995-c3, col_values=(('external_ids', {'iface-id': '4c5b9995-c31f-4d2b-8426-654e16b213bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:26:a7', 'vm-uuid': 'b002ac80-978b-490c-89ed-2031b850a4e1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:35 user nova-compute[76049]: INFO os_vif [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:26:a7,bridge_name='br-int',has_traffic_filtering=True,id=4c5b9995-c31f-4d2b-8426-654e16b213bd,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5b9995-c3')
Nov 15 11:10:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] No BDM found with device name hda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] No VIF found with MAC fa:16:3e:af:1c:62, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] No VIF found with MAC fa:16:3e:00:0d:7f, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:10:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Using config drive
Nov 15 11:10:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Creating config drive at /opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1/disk.config
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuda6vfig {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuda6vfig" returned: 0 in 0.069s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== connect_volume: return (2685ms) {'type': 'block', 'scsi_wwn': '23539643036343436', 'path': '/dev/sdg'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539643036343436', 'path': '/dev/sdg'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjQlTgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:10:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:10:35 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8349f1ba-f300-497f-a4f3-504cc9985a21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:10:35 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8342d094-a360-4b54-890e-cfa21e8da1a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722] added
Nov 15 11:10:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c03e01-c4fd-491e-98d4-d017a552ef74]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0b19fd-1f94-40ef-b310-9e8d017dc285]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjQlTgdo {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjQlTgdo" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab69fbb-586d-4f71-8dae-bdbdb38cf1c0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BjQlTgdo'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff06924f-a3f3-4682-8d88-061885c9ff8e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6a96e1-c9eb-4407-a368-f492af4a3097]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:10:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba49374-55a2-44a7-a164-d00ba51eab70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260]
Nov 15 11:10:36 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260] successful.
Nov 15 11:10:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd41f1c-ff47-45c3-9fc2-df1c95188f84]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dfee41-b35a-441e-8fa8-4f728719ee0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:10:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ddc71a-9ded-44c3-92b4-e579b144c373]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjQlTgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26236393962323236', 'path': '/dev/sdh'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236393962323236', 'path': '/dev/sdh'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-31a22ebb-1918-4b83-8c7e-24e6c8426c29 req-77bf6151-1d8b-4ea2-93e8-63ead9a366c5 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-31a22ebb-1918-4b83-8c7e-24e6c8426c29 req-77bf6151-1d8b-4ea2-93e8-63ead9a366c5 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-31a22ebb-1918-4b83-8c7e-24e6c8426c29 req-77bf6151-1d8b-4ea2-93e8-63ead9a366c5 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-31a22ebb-1918-4b83-8c7e-24e6c8426c29 req-77bf6151-1d8b-4ea2-93e8-63ead9a366c5 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-31a22ebb-1918-4b83-8c7e-24e6c8426c29 req-77bf6151-1d8b-4ea2-93e8-63ead9a366c5 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:37 user nova-compute[76049]: WARNING nova.compute.manager [req-31a22ebb-1918-4b83-8c7e-24e6c8426c29 req-77bf6151-1d8b-4ea2-93e8-63ead9a366c5 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 for instance with vm_state building and task_state spawning.
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:0a,bridge_name='br-int',has_traffic_filtering=True,id=83e89ce0-ade3-4004-9479-ab4c18968959,network=Network(231c2161-ed69-4f89-b3ad-9247a1ac0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e89ce0-ad') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:35:64,bridge_name='br-int',has_traffic_filtering=True,id=b3ffb2ec-11af-45de-a8dc-71263904b4ad,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3ffb2ec-11') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:93:43,bridge_name='br-int',has_traffic_filtering=True,id=4e410728-06eb-4513-8b9f-2a3c93c8af1e,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e410728-06') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=9e2778b2-2e82-437e-9b8c-64cba0c7165b,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2778b2-2e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:13:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cc0cf5e-e34a-489e-86bf-0055280695d7,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0cf5e-e3') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c3:cc,bridge_name='br-int',has_traffic_filtering=True,id=fec0748e-c7bd-47b4-a5e8-bf4d14ad959b,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec0748e-c7') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=043cd6d1-7987-4ea2-921d-28568431277d,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043cd6d1-79') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lazy-loading 'pci_devices' on Instance uuid 84391b07-a2b0-4053-b6d5-3d9912dcb7aa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:10:37 user nova-compute[76049]:   <uuid>84391b07-a2b0-4053-b6d5-3d9912dcb7aa</uuid>
Nov 15 11:10:37 user nova-compute[76049]:   <name>instance-0000000a</name>
Nov 15 11:10:37 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:10:37 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:10:37 user nova-compute[76049]:   <metadata>
Nov 15 11:10:37 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:10:37 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:10:37 user nova-compute[76049]:       <nova:name>tempest-device-tagging-server-1563933811</nova:name>
Nov 15 11:10:37 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:10:31</nova:creationTime>
Nov 15 11:10:37 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:10:37 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:10:37 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:10:37 user nova-compute[76049]:       <nova:owner>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:user uuid="3c143073e9cd4d7c9ac0423a6ce2da5e">tempest-TaggedBootDevicesTest_v242-1882503912-project-member</nova:user>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:project uuid="2a967062ddbe4838a5d4fefcec26e905">tempest-TaggedBootDevicesTest_v242-1882503912</nova:project>
Nov 15 11:10:37 user nova-compute[76049]:       </nova:owner>
Nov 15 11:10:37 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:10:37 user nova-compute[76049]:       <nova:ports>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:port uuid="83e89ce0-ade3-4004-9479-ab4c18968959">
Nov 15 11:10:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 11:10:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:port uuid="b3ffb2ec-11af-45de-a8dc-71263904b4ad">
Nov 15 11:10:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Nov 15 11:10:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:port uuid="4e410728-06eb-4513-8b9f-2a3c93c8af1e">
Nov 15 11:10:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Nov 15 11:10:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:port uuid="9e2778b2-2e82-437e-9b8c-64cba0c7165b">
Nov 15 11:10:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Nov 15 11:10:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:port uuid="4cc0cf5e-e34a-489e-86bf-0055280695d7">
Nov 15 11:10:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Nov 15 11:10:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:port uuid="fec0748e-c7bd-47b4-a5e8-bf4d14ad959b">
Nov 15 11:10:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 11:10:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:37 user nova-compute[76049]:         <nova:port uuid="043cd6d1-7987-4ea2-921d-28568431277d">
Nov 15 11:10:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 11:10:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:37 user nova-compute[76049]:       </nova:ports>
Nov 15 11:10:37 user nova-compute[76049]:     </nova:instance>
Nov 15 11:10:37 user nova-compute[76049]:   </metadata>
Nov 15 11:10:37 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:10:37 user nova-compute[76049]:     <system>
Nov 15 11:10:37 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:10:37 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:10:37 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:10:37 user nova-compute[76049]:       <entry name="serial">84391b07-a2b0-4053-b6d5-3d9912dcb7aa</entry>
Nov 15 11:10:37 user nova-compute[76049]:       <entry name="uuid">84391b07-a2b0-4053-b6d5-3d9912dcb7aa</entry>
Nov 15 11:10:37 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:10:37 user nova-compute[76049]:     </system>
Nov 15 11:10:37 user nova-compute[76049]:   </sysinfo>
Nov 15 11:10:37 user nova-compute[76049]:   <os>
Nov 15 11:10:37 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:10:37 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:10:37 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:10:37 user nova-compute[76049]:   </os>
Nov 15 11:10:37 user nova-compute[76049]:   <features>
Nov 15 11:10:37 user nova-compute[76049]:     <acpi/>
Nov 15 11:10:37 user nova-compute[76049]:     <apic/>
Nov 15 11:10:37 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:10:37 user nova-compute[76049]:   </features>
Nov 15 11:10:37 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:10:37 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:10:37 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:10:37 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:10:37 user nova-compute[76049]:   </clock>
Nov 15 11:10:37 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:10:37 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:10:37 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:10:37 user nova-compute[76049]:   </cpu>
Nov 15 11:10:37 user nova-compute[76049]:   <devices>
Nov 15 11:10:37 user nova-compute[76049]:     <disk type="file" device="cdrom">
Nov 15 11:10:37 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 11:10:37 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa/disk.config"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="hda" bus="ide"/>
Nov 15 11:10:37 user nova-compute[76049]:     </disk>
Nov 15 11:10:37 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:10:37 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:10:37 user nova-compute[76049]:       <source dev="/dev/sde"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <serial>fd09170c-4649-4362-88a2-88e036d33816</serial>
Nov 15 11:10:37 user nova-compute[76049]:     </disk>
Nov 15 11:10:37 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:10:37 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:10:37 user nova-compute[76049]:       <source dev="/dev/sdg"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <serial>6a6afb24-dfc4-4ce6-9028-663fd8afa3d2</serial>
Nov 15 11:10:37 user nova-compute[76049]:     </disk>
Nov 15 11:10:37 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:10:37 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:10:37 user nova-compute[76049]:       <source dev="/dev/sdh"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="vdc" bus="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <serial>80851a8b-1f60-4d35-8e35-d226f3fef722</serial>
Nov 15 11:10:37 user nova-compute[76049]:     </disk>
Nov 15 11:10:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:37 user nova-compute[76049]:       <mac address="fa:16:3e:6e:a7:0a"/>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="tap83e89ce0-ad"/>
Nov 15 11:10:37 user nova-compute[76049]:     </interface>
Nov 15 11:10:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:37 user nova-compute[76049]:       <mac address="fa:16:3e:1e:35:64"/>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="tapb3ffb2ec-11"/>
Nov 15 11:10:37 user nova-compute[76049]:     </interface>
Nov 15 11:10:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:37 user nova-compute[76049]:       <mac address="fa:16:3e:0d:93:43"/>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="tap4e410728-06"/>
Nov 15 11:10:37 user nova-compute[76049]:     </interface>
Nov 15 11:10:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:37 user nova-compute[76049]:       <mac address="fa:16:3e:c3:c8:b8"/>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="tap9e2778b2-2e"/>
Nov 15 11:10:37 user nova-compute[76049]:     </interface>
Nov 15 11:10:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:37 user nova-compute[76049]:       <mac address="fa:16:3e:5e:13:b4"/>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="tap4cc0cf5e-e3"/>
Nov 15 11:10:37 user nova-compute[76049]:     </interface>
Nov 15 11:10:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:37 user nova-compute[76049]:       <mac address="fa:16:3e:01:c3:cc"/>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="tapfec0748e-c7"/>
Nov 15 11:10:37 user nova-compute[76049]:     </interface>
Nov 15 11:10:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:37 user nova-compute[76049]:       <mac address="fa:16:3e:6a:93:bd"/>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:37 user nova-compute[76049]:       <target dev="tap043cd6d1-79"/>
Nov 15 11:10:37 user nova-compute[76049]:     </interface>
Nov 15 11:10:37 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:10:37 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa/console.log" append="off"/>
Nov 15 11:10:37 user nova-compute[76049]:     </serial>
Nov 15 11:10:37 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:10:37 user nova-compute[76049]:     <video>
Nov 15 11:10:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:37 user nova-compute[76049]:     </video>
Nov 15 11:10:37 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:10:37 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:10:37 user nova-compute[76049]:     </rng>
Nov 15 11:10:37 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:10:37 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:10:37 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:10:37 user nova-compute[76049]:     </memballoon>
Nov 15 11:10:37 user nova-compute[76049]:   </devices>
Nov 15 11:10:37 user nova-compute[76049]: </domain>
Nov 15 11:10:37 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:0a,bridge_name='br-int',has_traffic_filtering=True,id=83e89ce0-ade3-4004-9479-ab4c18968959,network=Network(231c2161-ed69-4f89-b3ad-9247a1ac0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e89ce0-ad') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:0a,bridge_name='br-int',has_traffic_filtering=True,id=83e89ce0-ade3-4004-9479-ab4c18968959,network=Network(231c2161-ed69-4f89-b3ad-9247a1ac0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e89ce0-ad') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edf995d4-7920-5c03-b2b3-77477026d156', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83e89ce0-ad, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83e89ce0-ad, col_values=(('qos', UUID('d83db198-bdf4-4e46-8ae8-fc3518c80d01')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83e89ce0-ad, col_values=(('external_ids', {'iface-id': '83e89ce0-ade3-4004-9479-ab4c18968959', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:a7:0a', 'vm-uuid': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: INFO os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:0a,bridge_name='br-int',has_traffic_filtering=True,id=83e89ce0-ade3-4004-9479-ab4c18968959,network=Network(231c2161-ed69-4f89-b3ad-9247a1ac0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e89ce0-ad')
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:35:64,bridge_name='br-int',has_traffic_filtering=True,id=b3ffb2ec-11af-45de-a8dc-71263904b4ad,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3ffb2ec-11') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:35:64,bridge_name='br-int',has_traffic_filtering=True,id=b3ffb2ec-11af-45de-a8dc-71263904b4ad,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3ffb2ec-11') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '738e2e26-a305-5392-bf87-4f2249400062', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-f9b83552-d3c7-4dd6-8fab-3c3015e6f70c req-73b83705-6a3c-4442-8a82-0d5cf85286d0 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9b83552-d3c7-4dd6-8fab-3c3015e6f70c req-73b83705-6a3c-4442-8a82-0d5cf85286d0 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9b83552-d3c7-4dd6-8fab-3c3015e6f70c req-73b83705-6a3c-4442-8a82-0d5cf85286d0 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f9b83552-d3c7-4dd6-8fab-3c3015e6f70c req-73b83705-6a3c-4442-8a82-0d5cf85286d0 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-f9b83552-d3c7-4dd6-8fab-3c3015e6f70c req-73b83705-6a3c-4442-8a82-0d5cf85286d0 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:38 user nova-compute[76049]: WARNING nova.compute.manager [req-f9b83552-d3c7-4dd6-8fab-3c3015e6f70c req-73b83705-6a3c-4442-8a82-0d5cf85286d0 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 for instance with vm_state building and task_state spawning.
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3ffb2ec-11, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3ffb2ec-11, col_values=(('qos', UUID('e4d3c10f-3ea0-49f0-be0c-d70a4bacff30')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3ffb2ec-11, col_values=(('external_ids', {'iface-id': 'b3ffb2ec-11af-45de-a8dc-71263904b4ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:35:64', 'vm-uuid': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: INFO os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:35:64,bridge_name='br-int',has_traffic_filtering=True,id=b3ffb2ec-11af-45de-a8dc-71263904b4ad,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3ffb2ec-11')
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:93:43,bridge_name='br-int',has_traffic_filtering=True,id=4e410728-06eb-4513-8b9f-2a3c93c8af1e,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e410728-06') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:93:43,bridge_name='br-int',has_traffic_filtering=True,id=4e410728-06eb-4513-8b9f-2a3c93c8af1e,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e410728-06') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c86dc3ad-a3cc-5daf-b06b-d49d08d6f594', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e410728-06, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e410728-06, col_values=(('qos', UUID('083f344b-b43e-4acb-880e-d8947c99b25a')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e410728-06, col_values=(('external_ids', {'iface-id': '4e410728-06eb-4513-8b9f-2a3c93c8af1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:93:43', 'vm-uuid': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: INFO os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:93:43,bridge_name='br-int',has_traffic_filtering=True,id=4e410728-06eb-4513-8b9f-2a3c93c8af1e,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e410728-06')
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=9e2778b2-2e82-437e-9b8c-64cba0c7165b,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2778b2-2e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=9e2778b2-2e82-437e-9b8c-64cba0c7165b,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2778b2-2e') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-ae71a263-8b51-45f2-bec4-3f6035d245ab req-d95b34af-3ddb-4e0f-9e4b-aa45f8751b35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ae71a263-8b51-45f2-bec4-3f6035d245ab req-d95b34af-3ddb-4e0f-9e4b-aa45f8751b35 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ae71a263-8b51-45f2-bec4-3f6035d245ab req-d95b34af-3ddb-4e0f-9e4b-aa45f8751b35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ae71a263-8b51-45f2-bec4-3f6035d245ab req-d95b34af-3ddb-4e0f-9e4b-aa45f8751b35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-ae71a263-8b51-45f2-bec4-3f6035d245ab req-d95b34af-3ddb-4e0f-9e4b-aa45f8751b35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:38 user nova-compute[76049]: WARNING nova.compute.manager [req-ae71a263-8b51-45f2-bec4-3f6035d245ab req-d95b34af-3ddb-4e0f-9e4b-aa45f8751b35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 for instance with vm_state building and task_state spawning.
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0127df64-8ccd-5846-af36-af6556d6159d', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e2778b2-2e, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e2778b2-2e, col_values=(('qos', UUID('411647e5-0a9c-48b7-86df-8d3bb6bb2b1d')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e2778b2-2e, col_values=(('external_ids', {'iface-id': '9e2778b2-2e82-437e-9b8c-64cba0c7165b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:c8:b8', 'vm-uuid': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: INFO os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=9e2778b2-2e82-437e-9b8c-64cba0c7165b,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2778b2-2e')
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:13:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cc0cf5e-e34a-489e-86bf-0055280695d7,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0cf5e-e3') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:13:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cc0cf5e-e34a-489e-86bf-0055280695d7,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0cf5e-e3') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fb1fa3c-4a80-5b4b-b7bf-75f44c9adfbe', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cc0cf5e-e3, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cc0cf5e-e3, col_values=(('qos', UUID('53d1fff7-294e-4bf2-9e7d-183be025f073')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cc0cf5e-e3, col_values=(('external_ids', {'iface-id': '4cc0cf5e-e34a-489e-86bf-0055280695d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:13:b4', 'vm-uuid': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: INFO os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:13:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cc0cf5e-e34a-489e-86bf-0055280695d7,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0cf5e-e3')
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c3:cc,bridge_name='br-int',has_traffic_filtering=True,id=fec0748e-c7bd-47b4-a5e8-bf4d14ad959b,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec0748e-c7') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c3:cc,bridge_name='br-int',has_traffic_filtering=True,id=fec0748e-c7bd-47b4-a5e8-bf4d14ad959b,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec0748e-c7') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e36bf678-c456-5f2c-a467-68406c0f0608', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfec0748e-c7, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfec0748e-c7, col_values=(('qos', UUID('05a16c8f-8d4f-40df-838a-cf227a47155a')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfec0748e-c7, col_values=(('external_ids', {'iface-id': 'fec0748e-c7bd-47b4-a5e8-bf4d14ad959b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:c3:cc', 'vm-uuid': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: INFO os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c3:cc,bridge_name='br-int',has_traffic_filtering=True,id=fec0748e-c7bd-47b4-a5e8-bf4d14ad959b,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec0748e-c7')
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=043cd6d1-7987-4ea2-921d-28568431277d,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043cd6d1-79') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=043cd6d1-7987-4ea2-921d-28568431277d,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043cd6d1-79') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71c8449f-d05b-5eef-9d26-5e97c982cc23', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap043cd6d1-79, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap043cd6d1-79, col_values=(('qos', UUID('9551f7b1-ff59-41d1-8044-765ade2a1ea8')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap043cd6d1-79, col_values=(('external_ids', {'iface-id': '043cd6d1-7987-4ea2-921d-28568431277d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:93:bd', 'vm-uuid': '84391b07-a2b0-4053-b6d5-3d9912dcb7aa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:39 user nova-compute[76049]: WARNING nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 for instance with vm_state building and task_state spawning.
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:39 user nova-compute[76049]: WARNING nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 for instance with vm_state building and task_state spawning.
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:39 user nova-compute[76049]: WARNING nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 for instance with vm_state building and task_state spawning.
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:39 user nova-compute[76049]: WARNING nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed for instance with vm_state building and task_state spawning.
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:39 user nova-compute[76049]: WARNING nova.compute.manager [req-082f6c8a-98dc-49d7-83e8-28bcbfcec624 req-aed28670-37c9-432e-9259-48ea890ecb46 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed for instance with vm_state building and task_state spawning.
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: INFO os_vif [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=043cd6d1-7987-4ea2-921d-28568431277d,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043cd6d1-79')
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] No BDM found with device name hda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] No VIF found with MAC fa:16:3e:6e:a7:0a, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] No VIF found with MAC fa:16:3e:5e:13:b4, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:10:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Using config drive
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Creating config drive at /opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa/disk.config
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz2cl3hxj {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz2cl3hxj" returned: 0 in 0.059s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:40 user nova-compute[76049]: WARNING nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 for instance with vm_state building and task_state spawning.
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:40 user nova-compute[76049]: WARNING nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 for instance with vm_state building and task_state spawning.
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:40 user nova-compute[76049]: WARNING nova.compute.manager [req-50d0ed7b-e749-46fc-991a-9c5ca66afb24 req-babd134e-f985-47d7-bef3-26cffd031a8e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 for instance with vm_state building and task_state spawning.
Nov 15 11:10:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:40 user nova-compute[76049]: WARNING nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 for instance with vm_state building and task_state spawning.
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:40 user nova-compute[76049]: WARNING nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd for instance with vm_state building and task_state spawning.
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:40 user nova-compute[76049]: WARNING nova.compute.manager [req-5d742022-5ff1-4996-bd73-0bb98cc64c49 req-11809e25-2151-4fcb-ad77-2c93b750d901 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd for instance with vm_state building and task_state spawning.
Nov 15 11:10:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:10:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance spawned successfully.
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: INFO nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Took 12.66 seconds to spawn the instance on the hypervisor.
Nov 15 11:10:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: INFO nova.compute.manager [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Took 33.17 seconds to build instance.
Nov 15 11:10:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f375618d-ee50-4cfa-a13d-0665cb104982 tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "b002ac80-978b-490c-89ed-2031b850a4e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.283s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-36f71c34-51d4-473a-9916-342b6afb1431 req-3a6b2620-e97f-4818-b36c-79e6743c1043 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-36f71c34-51d4-473a-9916-342b6afb1431 req-3a6b2620-e97f-4818-b36c-79e6743c1043 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-36f71c34-51d4-473a-9916-342b6afb1431 req-3a6b2620-e97f-4818-b36c-79e6743c1043 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-36f71c34-51d4-473a-9916-342b6afb1431 req-3a6b2620-e97f-4818-b36c-79e6743c1043 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-36f71c34-51d4-473a-9916-342b6afb1431 req-3a6b2620-e97f-4818-b36c-79e6743c1043 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:42 user nova-compute[76049]: WARNING nova.compute.manager [req-36f71c34-51d4-473a-9916-342b6afb1431 req-3a6b2620-e97f-4818-b36c-79e6743c1043 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 for instance with vm_state building and task_state spawning.
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebf0bc89-c731-4bec-bac0-1fca2dff3ca1 req-d392d4b0-0da0-4ed4-a239-80638b4b7249 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebf0bc89-c731-4bec-bac0-1fca2dff3ca1 req-d392d4b0-0da0-4ed4-a239-80638b4b7249 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebf0bc89-c731-4bec-bac0-1fca2dff3ca1 req-d392d4b0-0da0-4ed4-a239-80638b4b7249 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebf0bc89-c731-4bec-bac0-1fca2dff3ca1 req-d392d4b0-0da0-4ed4-a239-80638b4b7249 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebf0bc89-c731-4bec-bac0-1fca2dff3ca1 req-d392d4b0-0da0-4ed4-a239-80638b4b7249 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:42 user nova-compute[76049]: WARNING nova.compute.manager [req-ebf0bc89-c731-4bec-bac0-1fca2dff3ca1 req-d392d4b0-0da0-4ed4-a239-80638b4b7249 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad for instance with vm_state building and task_state spawning.
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-a57e790c-221f-4b7e-a59c-178b43ad8c1d req-59cb70e2-b4cc-4bbf-8b33-3f4c47cede3a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a57e790c-221f-4b7e-a59c-178b43ad8c1d req-59cb70e2-b4cc-4bbf-8b33-3f4c47cede3a service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a57e790c-221f-4b7e-a59c-178b43ad8c1d req-59cb70e2-b4cc-4bbf-8b33-3f4c47cede3a service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a57e790c-221f-4b7e-a59c-178b43ad8c1d req-59cb70e2-b4cc-4bbf-8b33-3f4c47cede3a service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-a57e790c-221f-4b7e-a59c-178b43ad8c1d req-59cb70e2-b4cc-4bbf-8b33-3f4c47cede3a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-a57e790c-221f-4b7e-a59c-178b43ad8c1d req-59cb70e2-b4cc-4bbf-8b33-3f4c47cede3a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-b11d8952-8895-4422-add9-4b26be1a8816 req-e91e8246-2d88-46bf-b977-69ecf1233fc2 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-81c73fe3-673b-430b-9d19-738db521a8ec req-08b921dd-1ad2-4f65-814c-8758ef605e23 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81c73fe3-673b-430b-9d19-738db521a8ec req-08b921dd-1ad2-4f65-814c-8758ef605e23 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81c73fe3-673b-430b-9d19-738db521a8ec req-08b921dd-1ad2-4f65-814c-8758ef605e23 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81c73fe3-673b-430b-9d19-738db521a8ec req-08b921dd-1ad2-4f65-814c-8758ef605e23 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-81c73fe3-673b-430b-9d19-738db521a8ec req-08b921dd-1ad2-4f65-814c-8758ef605e23 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:44 user nova-compute[76049]: WARNING nova.compute.manager [req-81c73fe3-673b-430b-9d19-738db521a8ec req-08b921dd-1ad2-4f65-814c-8758ef605e23 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad for instance with vm_state building and task_state spawning.
Nov 15 11:10:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:10:45 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance spawned successfully.
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:46 user nova-compute[76049]: INFO nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Took 14.85 seconds to spawn the instance on the hypervisor.
Nov 15 11:10:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:46 user nova-compute[76049]: WARNING nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b for instance with vm_state building and task_state spawning.
Nov 15 11:10:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:46 user nova-compute[76049]: WARNING nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b for instance with vm_state building and task_state spawning.
Nov 15 11:10:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:46 user nova-compute[76049]: WARNING nova.compute.manager [req-b8e772f2-7ec2-4247-bd48-82dd525364f5 req-1267d380-21a2-43a6-9033-c77858f8cf84 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b for instance with vm_state building and task_state spawning.
Nov 15 11:10:46 user nova-compute[76049]: INFO nova.compute.manager [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Took 38.05 seconds to build instance.
Nov 15 11:10:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9910cd95-c01e-4b54-adb8-de536e7bb913 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.232s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:10:52 user nova-compute[76049]: INFO nova.compute.claims [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Claim successful on node user
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.network.neutron [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:10:52 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:10:52 user nova-compute[76049]: DEBUG nova.policy [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092762011c594cb6b7badf4bbafe513e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df502284cb84433a1ddd5195da15df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:10:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Creating image(s)
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "/opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "/opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "/opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.270s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.354s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG nova.network.neutron [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Successfully created port: a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk 1073741824" returned: 0 in 0.056s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.416s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:10:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Cannot resize image /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Ensure instance console log exists: /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Successfully updated port: a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquired lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Received event network-changed-a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Refreshing instance network info cache due to event network-changed-a7f86da6-569a-42f5-9489-5ac29a0eee39. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] Acquiring lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Updating instance_info_cache with network_info: [{"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Releasing lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Instance network_info: |[{"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] Acquired lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.neutron [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Refreshing network info cache for port a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Start _get_guest_xml network_info=[{"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:10:54 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:54 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1345929207',display_name='tempest-VolumesSnapshotTestJSON-instance-1345929207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1345929207',id=12,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlJ5ozxaXwFxFKKGgDtk7VF87F9ep16Mu8EyT1Op64krn0Oc1dVDD+dIrR9vnJq6+GDkY1APKOK/4f7NZ2BbzcsMXjQKTn9e5Tw7NNVwTg1c0FhZYJqZ1Jcbgj+WfQfcQ==',key_name='tempest-keypair-1569309691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df502284cb84433a1ddd5195da15df8',ramdisk_id='',reservation_id='r-wu0pjuam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-753677889',owner_user_name='tempest-VolumesSnapshotTestJSON-753677889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092762011c594cb6b7badf4bbafe513e',uuid=257a8a67-6214-4cee-a280-dff1a1420f5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converting VIF {"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7f86da6-569a-42f5-9489-5ac29a0eee39,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f86da6-56') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'pci_devices' on Instance uuid 257a8a67-6214-4cee-a280-dff1a1420f5f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:10:54 user nova-compute[76049]:   <uuid>257a8a67-6214-4cee-a280-dff1a1420f5f</uuid>
Nov 15 11:10:54 user nova-compute[76049]:   <name>instance-0000000c</name>
Nov 15 11:10:54 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:10:54 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:10:54 user nova-compute[76049]:   <metadata>
Nov 15 11:10:54 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:10:54 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:10:54 user nova-compute[76049]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1345929207</nova:name>
Nov 15 11:10:54 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:10:54</nova:creationTime>
Nov 15 11:10:54 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:10:54 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:10:54 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:10:54 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:10:54 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:10:54 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:10:54 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:10:54 user nova-compute[76049]:       <nova:owner>
Nov 15 11:10:54 user nova-compute[76049]:         <nova:user uuid="092762011c594cb6b7badf4bbafe513e">tempest-VolumesSnapshotTestJSON-753677889-project-member</nova:user>
Nov 15 11:10:54 user nova-compute[76049]:         <nova:project uuid="3df502284cb84433a1ddd5195da15df8">tempest-VolumesSnapshotTestJSON-753677889</nova:project>
Nov 15 11:10:54 user nova-compute[76049]:       </nova:owner>
Nov 15 11:10:54 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:10:54 user nova-compute[76049]:       <nova:ports>
Nov 15 11:10:54 user nova-compute[76049]:         <nova:port uuid="a7f86da6-569a-42f5-9489-5ac29a0eee39">
Nov 15 11:10:54 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 11:10:54 user nova-compute[76049]:         </nova:port>
Nov 15 11:10:54 user nova-compute[76049]:       </nova:ports>
Nov 15 11:10:54 user nova-compute[76049]:     </nova:instance>
Nov 15 11:10:54 user nova-compute[76049]:   </metadata>
Nov 15 11:10:54 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:10:54 user nova-compute[76049]:     <system>
Nov 15 11:10:54 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:10:54 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:10:54 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:10:54 user nova-compute[76049]:       <entry name="serial">257a8a67-6214-4cee-a280-dff1a1420f5f</entry>
Nov 15 11:10:54 user nova-compute[76049]:       <entry name="uuid">257a8a67-6214-4cee-a280-dff1a1420f5f</entry>
Nov 15 11:10:54 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:10:54 user nova-compute[76049]:     </system>
Nov 15 11:10:54 user nova-compute[76049]:   </sysinfo>
Nov 15 11:10:54 user nova-compute[76049]:   <os>
Nov 15 11:10:54 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:10:54 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:10:54 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:10:54 user nova-compute[76049]:   </os>
Nov 15 11:10:54 user nova-compute[76049]:   <features>
Nov 15 11:10:54 user nova-compute[76049]:     <acpi/>
Nov 15 11:10:54 user nova-compute[76049]:     <apic/>
Nov 15 11:10:54 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:10:54 user nova-compute[76049]:   </features>
Nov 15 11:10:54 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:10:54 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:10:54 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:10:54 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:10:54 user nova-compute[76049]:   </clock>
Nov 15 11:10:54 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:10:54 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:10:54 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:10:54 user nova-compute[76049]:   </cpu>
Nov 15 11:10:54 user nova-compute[76049]:   <devices>
Nov 15 11:10:54 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:10:54 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:10:54 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk"/>
Nov 15 11:10:54 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:10:54 user nova-compute[76049]:     </disk>
Nov 15 11:10:54 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:10:54 user nova-compute[76049]:       <mac address="fa:16:3e:21:11:ad"/>
Nov 15 11:10:54 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:54 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:10:54 user nova-compute[76049]:       <target dev="tapa7f86da6-56"/>
Nov 15 11:10:54 user nova-compute[76049]:     </interface>
Nov 15 11:10:54 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:10:54 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/console.log" append="off"/>
Nov 15 11:10:54 user nova-compute[76049]:     </serial>
Nov 15 11:10:54 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:10:54 user nova-compute[76049]:     <video>
Nov 15 11:10:54 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:10:54 user nova-compute[76049]:     </video>
Nov 15 11:10:54 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:10:54 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:10:54 user nova-compute[76049]:     </rng>
Nov 15 11:10:54 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:10:54 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:10:54 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:10:54 user nova-compute[76049]:     </memballoon>
Nov 15 11:10:54 user nova-compute[76049]:   </devices>
Nov 15 11:10:54 user nova-compute[76049]: </domain>
Nov 15 11:10:54 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1345929207',display_name='tempest-VolumesSnapshotTestJSON-instance-1345929207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1345929207',id=12,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlJ5ozxaXwFxFKKGgDtk7VF87F9ep16Mu8EyT1Op64krn0Oc1dVDD+dIrR9vnJq6+GDkY1APKOK/4f7NZ2BbzcsMXjQKTn9e5Tw7NNVwTg1c0FhZYJqZ1Jcbgj+WfQfcQ==',key_name='tempest-keypair-1569309691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df502284cb84433a1ddd5195da15df8',ramdisk_id='',reservation_id='r-wu0pjuam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-753677889',owner_user_name='tempest-VolumesSnapshotTestJSON-753677889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092762011c594cb6b7badf4bbafe513e',uuid=257a8a67-6214-4cee-a280-dff1a1420f5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converting VIF {"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7f86da6-569a-42f5-9489-5ac29a0eee39,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f86da6-56') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG os_vif [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7f86da6-569a-42f5-9489-5ac29a0eee39,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f86da6-56') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8ab2483-a6d8-5966-b99c-8780d9b35059', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7f86da6-56, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7f86da6-56, col_values=(('qos', UUID('afe15ae4-986b-4e67-8afe-ad39fce32bbe')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7f86da6-56, col_values=(('external_ids', {'iface-id': 'a7f86da6-569a-42f5-9489-5ac29a0eee39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:11:ad', 'vm-uuid': '257a8a67-6214-4cee-a280-dff1a1420f5f'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:54 user nova-compute[76049]: INFO os_vif [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7f86da6-569a-42f5-9489-5ac29a0eee39,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f86da6-56')
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:10:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No VIF found with MAC fa:16:3e:21:11:ad, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:10:55 user nova-compute[76049]: DEBUG nova.network.neutron [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Updated VIF entry in instance network info cache for port a7f86da6-569a-42f5-9489-5ac29a0eee39. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:10:55 user nova-compute[76049]: DEBUG nova.network.neutron [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Updating instance_info_cache with network_info: [{"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:10:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-57d89114-c612-495d-9b43-55ef40f3c6a9 req-24f9dc81-5aab-4b86-b63c-d5c044457629 service nova] Releasing lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-a973441b-f9f9-4d15-93d3-22878452f72e req-25dfca58-d122-4857-8fbd-38f5fed7e636 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Received event network-vif-plugged-a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a973441b-f9f9-4d15-93d3-22878452f72e req-25dfca58-d122-4857-8fbd-38f5fed7e636 service nova] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a973441b-f9f9-4d15-93d3-22878452f72e req-25dfca58-d122-4857-8fbd-38f5fed7e636 service nova] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a973441b-f9f9-4d15-93d3-22878452f72e req-25dfca58-d122-4857-8fbd-38f5fed7e636 service nova] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-a973441b-f9f9-4d15-93d3-22878452f72e req-25dfca58-d122-4857-8fbd-38f5fed7e636 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] No waiting events found dispatching network-vif-plugged-a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:56 user nova-compute[76049]: WARNING nova.compute.manager [req-a973441b-f9f9-4d15-93d3-22878452f72e req-25dfca58-d122-4857-8fbd-38f5fed7e636 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Received unexpected event network-vif-plugged-a7f86da6-569a-42f5-9489-5ac29a0eee39 for instance with vm_state building and task_state spawning.
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:10:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Instance spawned successfully.
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-fe731d9e-1118-4cfe-bef3-a4f7643c6e31 req-1b5b928f-91ef-40ef-bece-639f174db569 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Received event network-vif-plugged-a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fe731d9e-1118-4cfe-bef3-a4f7643c6e31 req-1b5b928f-91ef-40ef-bece-639f174db569 service nova] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fe731d9e-1118-4cfe-bef3-a4f7643c6e31 req-1b5b928f-91ef-40ef-bece-639f174db569 service nova] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fe731d9e-1118-4cfe-bef3-a4f7643c6e31 req-1b5b928f-91ef-40ef-bece-639f174db569 service nova] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-fe731d9e-1118-4cfe-bef3-a4f7643c6e31 req-1b5b928f-91ef-40ef-bece-639f174db569 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] No waiting events found dispatching network-vif-plugged-a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:10:58 user nova-compute[76049]: WARNING nova.compute.manager [req-fe731d9e-1118-4cfe-bef3-a4f7643c6e31 req-1b5b928f-91ef-40ef-bece-639f174db569 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Received unexpected event network-vif-plugged-a7f86da6-569a-42f5-9489-5ac29a0eee39 for instance with vm_state building and task_state spawning.
Nov 15 11:10:58 user nova-compute[76049]: INFO nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 15 11:10:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:10:58 user nova-compute[76049]: INFO nova.compute.manager [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Took 6.44 seconds to build instance.
Nov 15 11:10:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-99f03551-0a31-4ab6-a164-dba0d770fb93 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.536s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:10:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lazy-loading 'flavor' on Instance uuid 4688fd69-68cc-4345-b191-9d92c2e9456a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:04 user nova-compute[76049]: INFO nova.compute.manager [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Attaching volume 4e43cfc9-e031-48b0-801e-07b4d6d523f5 to /dev/vdb
Nov 15 11:11:04 user nova-compute[76049]: DEBUG os_brick.utils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4186249c-38a1-477f-b092-8470982f8b9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc89915-345b-46f2-b518-275c47bef87b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[40164581-b275-4f60-91c7-efe852273f59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb22b023-6e8a-4c59-b8c0-c1c696c2fb08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:04 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:11:04 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b41000-a0e2-42a1-8a07-f4aee0321ba5]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG os_brick.utils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updating existing volume attachment record: 10a2e391-fc37-41e2-803a-b864e181074e {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:11:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNftHilz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:09 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:09 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:09 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260" returned: 21 in 0.047s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a83364-3fcd-4e75-9fb0-29c233ab7af6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:11:09 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37f5745-e7cc-4e6c-b432-26e7fa963f34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5] added
Nov 15 11:11:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52a2e0-a2c5-450b-97ee-f2eff11bcea0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ea9549-4a3e-44ec-b03c-4c4bba2f0cb8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNftHilz {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNftHilz" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff342a7d-3cc0-4c81-b698-497639957f9e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNftHilz'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b71c700-9489-4333-b04f-ea1b509930f3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[985cffe7-00af-47fb-8009-a9e5b20f7b60]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e221a84f-4d7e-4577-ad69-6b87db6691d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260]
Nov 15 11:11:09 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b69b34-2110-4dcf-aa49-52a10ef25b7a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5141e0f-a743-4961-b7af-5b4b4cb08faa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 (non-flash)
Nov 15 11:11:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54cc32a-4ab2-46de-b700-366e21a22d8a]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:11:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNftHilz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:11:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26531633237313839', 'path': '/dev/sdi'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531633237313839', 'path': '/dev/sdi'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:11:10 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lazy-loading 'flavor' on Instance uuid 4688fd69-68cc-4345-b191-9d92c2e9456a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:11:10 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:10 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:11:10 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:10 user nova-compute[76049]:   <serial>4e43cfc9-e031-48b0-801e-07b4d6d523f5</serial>
Nov 15 11:11:10 user nova-compute[76049]: </disk>
Nov 15 11:11:10 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] No VIF found with MAC fa:16:3e:2d:89:0e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7fb7ae2d-52ec-451d-8077-98891c5a6c21 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.354s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:11 user nova-compute[76049]: INFO nova.compute.manager [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Terminating instance
Nov 15 11:11:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-17f3a39c-001b-46a8-924a-4d501216ca7d req-a02b9e24-49f3-4c5a-8af8-f0cc037ca428 service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received event network-vif-unplugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-17f3a39c-001b-46a8-924a-4d501216ca7d req-a02b9e24-49f3-4c5a-8af8-f0cc037ca428 service nova] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-17f3a39c-001b-46a8-924a-4d501216ca7d req-a02b9e24-49f3-4c5a-8af8-f0cc037ca428 service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-17f3a39c-001b-46a8-924a-4d501216ca7d req-a02b9e24-49f3-4c5a-8af8-f0cc037ca428 service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-17f3a39c-001b-46a8-924a-4d501216ca7d req-a02b9e24-49f3-4c5a-8af8-f0cc037ca428 service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] No waiting events found dispatching network-vif-unplugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-17f3a39c-001b-46a8-924a-4d501216ca7d req-a02b9e24-49f3-4c5a-8af8-f0cc037ca428 service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received event network-vif-unplugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Instance destroyed successfully.
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lazy-loading 'resources' on Instance uuid 4688fd69-68cc-4345-b191-9d92c2e9456a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-352509533',display_name='tempest-DeleteServersTestJSON-server-352509533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-352509533',id=1,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0e28b05b2524b688c740523ac2e8e1e',ramdisk_id='',reservation_id='r-v9pl1fpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-647641200',owner_user_name='tempest-DeleteServersTestJSON-647641200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:27Z,user_data=None,user_id='054f6d96df9a4df6aa4f5b00e6b1f56e',uuid=4688fd69-68cc-4345-b191-9d92c2e9456a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Converting VIF {"id": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "address": "fa:16:3e:2d:89:0e", "network": {"id": "81a5ed4b-d256-4852-9c17-e88c4b0dc87b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1172508468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e28b05b2524b688c740523ac2e8e1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a643d-01", "ovs_interfaceid": "cf5a643d-0107-4edd-ba4b-72058019a2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:89:0e,bridge_name='br-int',has_traffic_filtering=True,id=cf5a643d-0107-4edd-ba4b-72058019a2e2,network=Network(81a5ed4b-d256-4852-9c17-e88c4b0dc87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a643d-01') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_vif [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:89:0e,bridge_name='br-int',has_traffic_filtering=True,id=cf5a643d-0107-4edd-ba4b-72058019a2e2,network=Network(81a5ed4b-d256-4852-9c17-e88c4b0dc87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a643d-01') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf5a643d-01, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b0aa4a2-2424-437e-b7a7-519dc95ff393) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:12 user nova-compute[76049]: INFO os_vif [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:89:0e,bridge_name='br-int',has_traffic_filtering=True,id=cf5a643d-0107-4edd-ba4b-72058019a2e2,network=Network(81a5ed4b-d256-4852-9c17-e88c4b0dc87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a643d-01')
Nov 15 11:11:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNftHilz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:12 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[17576d60-371f-41a6-aac0-68fcb2d32982]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:11:12 user nova-compute[76049]: No targets found.
Nov 15 11:11:12 user nova-compute[76049]: iSNS:
Nov 15 11:11:12 user nova-compute[76049]: No targets found.
Nov 15 11:11:12 user nova-compute[76049]: STATIC:
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:11:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:12 user nova-compute[76049]: FIRMWARE:
Nov 15 11:11:12 user nova-compute[76049]: No targets found.
Nov 15 11:11:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:11:12 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:11:12 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdbf53e-4cf5-4375-ad02-b1bd32084838]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6dd86f-d003-4ba8-a04e-d55a91e14622]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 (non-flash)
Nov 15 11:11:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f628440e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5'): ({'sdi'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Removing single pathed devices sdi {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0ebb3c-031e-4ff8-836d-6d4a12a39f45]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee922b2c-5fa5-42a2-8813-b511ea009b6b]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Flushing IO for device /dev/sdi {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.011s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75f98d3-d353-49e6-965c-2f87ef30bc62]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5676a6ae-47cc-4b0b-a916-4824646d90ce]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe95b940-8d0f-4d34-aa4f-ceb4034c1a2e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bff2f72-fb62-47e4-bf4d-da2449e15032]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260]
Nov 15 11:11:13 user nova-compute[76049]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:13 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e43cfc9-e031-48b0-801e-07b4d6d523f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dfb364-7b71-41a0-b430-3ffd176eca79]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] <== disconnect_volume: return (315ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:11:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Deleting instance files /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a_del
Nov 15 11:11:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Deletion of /opt/stack/data/nova/instances/4688fd69-68cc-4345-b191-9d92c2e9456a_del complete
Nov 15 11:11:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Checking UEFI support for host arch (x86_64) {{(pid=76049) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 11:11:13 user nova-compute[76049]: INFO nova.virt.libvirt.host [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] UEFI support detected
Nov 15 11:11:13 user nova-compute[76049]: INFO nova.compute.manager [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 11:11:13 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:11:13 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:11:14 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:14 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Took 0.96 seconds to deallocate network for instance.
Nov 15 11:11:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-830ebf77-8b72-4b85-b08e-3f42660481a4 req-69ec6358-b384-4b58-81b4-d1b41e6ac73e service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received event network-vif-deleted-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:14 user nova-compute[76049]: INFO nova.compute.manager [req-830ebf77-8b72-4b85-b08e-3f42660481a4 req-69ec6358-b384-4b58-81b4-d1b41e6ac73e service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Neutron deleted interface cf5a643d-0107-4edd-ba4b-72058019a2e2; detaching it from the instance and deleting it from the info cache
Nov 15 11:11:14 user nova-compute[76049]: DEBUG nova.network.neutron [req-830ebf77-8b72-4b85-b08e-3f42660481a4 req-69ec6358-b384-4b58-81b4-d1b41e6ac73e service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-830ebf77-8b72-4b85-b08e-3f42660481a4 req-69ec6358-b384-4b58-81b4-d1b41e6ac73e service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Detach interface failed, port_id=cf5a643d-0107-4edd-ba4b-72058019a2e2, reason: Instance 4688fd69-68cc-4345-b191-9d92c2e9456a could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:11:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-d56b2675-c009-4b78-acb6-868da3bcf293 req-7e53163c-daf5-4524-98ae-791dc0a9ef91 service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received event network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d56b2675-c009-4b78-acb6-868da3bcf293 req-7e53163c-daf5-4524-98ae-791dc0a9ef91 service nova] Acquiring lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d56b2675-c009-4b78-acb6-868da3bcf293 req-7e53163c-daf5-4524-98ae-791dc0a9ef91 service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d56b2675-c009-4b78-acb6-868da3bcf293 req-7e53163c-daf5-4524-98ae-791dc0a9ef91 service nova] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-d56b2675-c009-4b78-acb6-868da3bcf293 req-7e53163c-daf5-4524-98ae-791dc0a9ef91 service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] No waiting events found dispatching network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:14 user nova-compute[76049]: WARNING nova.compute.manager [req-d56b2675-c009-4b78-acb6-868da3bcf293 req-7e53163c-daf5-4524-98ae-791dc0a9ef91 service nova] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Received unexpected event network-vif-plugged-cf5a643d-0107-4edd-ba4b-72058019a2e2 for instance with vm_state active and task_state deleting.
Nov 15 11:11:14 user nova-compute[76049]: INFO nova.compute.manager [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] [instance: 4688fd69-68cc-4345-b191-9d92c2e9456a] Took 0.80 seconds to detach 1 volumes for instance.
Nov 15 11:11:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:15 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:11:15 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:11:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:15 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Deleted allocations for instance 4688fd69-68cc-4345-b191-9d92c2e9456a
Nov 15 11:11:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e561eec-2efb-417c-aaf1-44beeb3fae04 tempest-DeleteServersTestJSON-647641200 tempest-DeleteServersTestJSON-647641200-project-member] Lock "4688fd69-68cc-4345-b191-9d92c2e9456a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.592s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing instance network info cache due to event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updated VIF entry in instance network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fcc19299-b891-4a67-8a72-3ebea67d909b req-3350833c-35f4-4f0f-8208-2ade301b405c service nova] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:17 user nova-compute[76049]: INFO nova.compute.manager [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Shelving
Nov 15 11:11:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-4dd9e094-9bb9-4ef5-ad02-47b2c01ecb26 req-559cfbb9-055d-4aaf-958f-2da9c9f0a469 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-unplugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4dd9e094-9bb9-4ef5-ad02-47b2c01ecb26 req-559cfbb9-055d-4aaf-958f-2da9c9f0a469 service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4dd9e094-9bb9-4ef5-ad02-47b2c01ecb26 req-559cfbb9-055d-4aaf-958f-2da9c9f0a469 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4dd9e094-9bb9-4ef5-ad02-47b2c01ecb26 req-559cfbb9-055d-4aaf-958f-2da9c9f0a469 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-4dd9e094-9bb9-4ef5-ad02-47b2c01ecb26 req-559cfbb9-055d-4aaf-958f-2da9c9f0a469 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-unplugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:17 user nova-compute[76049]: WARNING nova.compute.manager [req-4dd9e094-9bb9-4ef5-ad02-47b2c01ecb26 req-559cfbb9-055d-4aaf-958f-2da9c9f0a469 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-unplugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state active and task_state shelving.
Nov 15 11:11:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance destroyed successfully.
Nov 15 11:11:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Beginning cold snapshot process
Nov 15 11:11:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:11:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk /opt/stack/data/nova/instances/snapshots/tmpow53lzly/7627c00b8f064008ae498f94d1b67659 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk /opt/stack/data/nova/instances/snapshots/tmpow53lzly/7627c00b8f064008ae498f94d1b67659" returned: 0 in 0.911s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Snapshot extracted, beginning image upload
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-431a6678-758c-4970-83a9-12005fb633bc req-3925ec56-2554-4a57-a754-60e323b7131f service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-431a6678-758c-4970-83a9-12005fb633bc req-3925ec56-2554-4a57-a754-60e323b7131f service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-431a6678-758c-4970-83a9-12005fb633bc req-3925ec56-2554-4a57-a754-60e323b7131f service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-431a6678-758c-4970-83a9-12005fb633bc req-3925ec56-2554-4a57-a754-60e323b7131f service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-431a6678-758c-4970-83a9-12005fb633bc req-3925ec56-2554-4a57-a754-60e323b7131f service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:19 user nova-compute[76049]: WARNING nova.compute.manager [req-431a6678-758c-4970-83a9-12005fb633bc req-3925ec56-2554-4a57-a754-60e323b7131f service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Snapshot image upload complete
Nov 15 11:11:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:11:21 user nova-compute[76049]: INFO nova.compute.manager [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Shelve offloading
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance destroyed successfully.
Nov 15 11:11:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:11:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:22 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:11:22 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=6835MB free_disk=25.58928680419922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d23b5032-89df-47d6-93fa-496bd3d5671c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance cc582aae-00f7-4c3d-b551-a70aac92d7ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a920e6ce-95d2-445c-b485-548da3d81042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c14698a2-4375-4eff-b590-da9bd6b705c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a839d9dc-b17f-421b-ac5e-6a22cffd10fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8a944329-f077-4be4-b780-492b9e9d978d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6bce81ea-2634-40fe-945b-afe6c1e09a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 84391b07-a2b0-4053-b6d5-3d9912dcb7aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b002ac80-978b-490c-89ed-2031b850a4e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 257a8a67-6214-4cee-a280-dff1a1420f5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:11:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance destroyed successfully.
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.objects.instance [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'resources' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-393013812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-393013812',id=2,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8LEUVi10YoVRk8Bt3EmnWh9/k9X2INlqp/sb6d1S9EQYyuTkFw6kJNq6qzcERUuGw5MvT+duO6T6+Uq2l2vnP4xs4tbX3GSnkbIODd2HgeX3znRsIJo5AxpueBFN8D4Q==',key_name='tempest-keypair-1888008997',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-q1vxyx50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member',shelved_at='2023-11-15T11:11:21.880716',shelved_host='user',shelved_image_id='688d7e77-3501-43d1-9f90-4d1aaf9ab3b2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=d23b5032-89df-47d6-93fa-496bd3d5671c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG os_vif [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1bdc1ea-ee, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing instance network info cache due to event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56cc5f8b-97fb-4369-897e-0b865bc35def) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:23 user nova-compute[76049]: INFO os_vif [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee')
Nov 15 11:11:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Deleting instance files /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c_del
Nov 15 11:11:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Deletion of /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c_del complete
Nov 15 11:11:23 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Deleted allocations for instance d23b5032-89df-47d6-93fa-496bd3d5671c
Nov 15 11:11:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.objects.instance [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'numa_topology' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:23 user nova-compute[76049]: DEBUG nova.objects.base [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<d23b5032-89df-47d6-93fa-496bd3d5671c> lazy-loaded attributes: resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:11:24 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:11:24 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:11:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-85ed1ec2-1352-4976-8e21-ae2072414d87 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.616s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updated VIF entry in instance network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d814d184-abd6-44d5-abc4-6eb119216776 req-e2e597d8-1f23-4d41-af93-6535b4376ab8 service nova] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-changed-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Refreshing instance network info cache due to event network-changed-1aa140e7-30ef-4482-a23f-d95d0b2a9da9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] Acquiring lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] Acquired lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG nova.network.neutron [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Refreshing network info cache for port 1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG nova.network.neutron [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updated VIF entry in instance network info cache for port 1aa140e7-30ef-4482-a23f-d95d0b2a9da9. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG nova.network.neutron [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updating instance_info_cache with network_info: [{"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2de84350-c276-4100-8e1f-40a230a0dc12 req-4d98b346-9276-492e-b305-607edff55446 service nova] Releasing lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:29 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lazy-loading 'flavor' on Instance uuid cc582aae-00f7-4c3d-b551-a70aac92d7ac {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-changed-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Refreshing instance network info cache due to event network-changed-cc2067b4-33bb-4cf7-9a0f-d7c2537308be. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] Acquiring lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] Acquired lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Refreshing network info cache for port cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:30 user nova-compute[76049]: INFO nova.compute.manager [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Attaching volume 3132fdd8-803a-43e9-9995-80107931eee4 to /dev/vdb
Nov 15 11:11:30 user nova-compute[76049]: DEBUG os_brick.utils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a98601-4f0f-4e23-9b41-62e9a0c09692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8e1d0c-9ead-4508-8623-2d26f88a2e8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfedf92-01d9-44ba-ba74-0d5334c0357c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee8d699-091f-4e2c-a5af-1a5ade411c70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:30 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f1054-2c11-4464-a6f1-33a8dceffa7f]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG os_brick.utils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updating existing volume attachment record: 552eaef9-cb67-48c9-a5b8-ade8bdcd283f {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Updated VIF entry in instance network info cache for port cc2067b4-33bb-4cf7-9a0f-d7c2537308be. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Updating instance_info_cache with network_info: [{"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-31509681-4edb-4d31-8533-309fba2fe6ad req-835a4545-ef3b-407c-bd55-d1cec2492ce1 service nova] Releasing lock "refresh_cache-a920e6ce-95d2-445c-b485-548da3d81042" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lazy-loading 'flavor' on Instance uuid a920e6ce-95d2-445c-b485-548da3d81042 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:32 user nova-compute[76049]: INFO nova.compute.manager [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Attaching volume 15253af8-4ab6-4c15-ae25-ce337851c2eb to /dev/sdc
Nov 15 11:11:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-changed-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Refreshing instance network info cache due to event network-changed-790cd537-de81-4c38-b956-e7844fe08df4. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] Acquiring lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] Acquired lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG nova.network.neutron [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Refreshing network info cache for port 790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG os_brick.utils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7dd1b7-f386-41cc-b8ae-d7122eb37ea8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85fc2aa-5a7b-43dd-8814-18f1449f744d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b46d65-6bd4-487c-974f-72f041c83c8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0718a17f-1e8f-482d-9eee-32b995873a4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:33 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dbd8b2-547a-4984-b7ea-faa3e10f9dfa]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG os_brick.utils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Updating existing volume attachment record: 35853fa6-281e-40bf-a979-d8646140f7ab {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updated VIF entry in instance network info cache for port 790cd537-de81-4c38-b956-e7844fe08df4. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updating instance_info_cache with network_info: [{"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13b22f83-40ed-4f59-abf9-af0b92e235dc req-b3aac043-9449-4d22-bd55-e83259540916 service nova] Releasing lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:33 user nova-compute[76049]: INFO nova.compute.manager [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Rebuilding instance
Nov 15 11:11:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-changed-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Refreshing instance network info cache due to event network-changed-3b9f20e6-2c85-4c46-bf59-4919ee8731ab. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] Acquiring lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] Acquired lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Refreshing network info cache for port 3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.network.neutron [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updated VIF entry in instance network info cache for port 3b9f20e6-2c85-4c46-bf59-4919ee8731ab. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.network.neutron [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-defc7469-c85e-4a2d-b35d-d66fef9c1519 req-3c21d22f-bed4-4070-8208-42708e02437e service nova] Releasing lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-a0588531-618e-4fc4-9e5a-2ebb5462aab2 req-b245e712-3bd1-4a4e-9c14-c19ff9bad62c service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-unplugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a0588531-618e-4fc4-9e5a-2ebb5462aab2 req-b245e712-3bd1-4a4e-9c14-c19ff9bad62c service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a0588531-618e-4fc4-9e5a-2ebb5462aab2 req-b245e712-3bd1-4a4e-9c14-c19ff9bad62c service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a0588531-618e-4fc4-9e5a-2ebb5462aab2 req-b245e712-3bd1-4a4e-9c14-c19ff9bad62c service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-a0588531-618e-4fc4-9e5a-2ebb5462aab2 req-b245e712-3bd1-4a4e-9c14-c19ff9bad62c service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-unplugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:34 user nova-compute[76049]: WARNING nova.compute.manager [req-a0588531-618e-4fc4-9e5a-2ebb5462aab2 req-b245e712-3bd1-4a4e-9c14-c19ff9bad62c service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received unexpected event network-vif-unplugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with vm_state active and task_state rebuilding.
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "interface-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "interface-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'flavor' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'pci_requests' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.objects.base [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Object Instance<60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a> lazy-loaded attributes: flavor,pci_requests {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.policy [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee64d748ff8940748cbddf050539088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01388fdbea2f40b38a8c4dd5f8c922c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:11:34 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance destroyed successfully.
Nov 15 11:11:34 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance destroyed successfully.
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1903236133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455564423',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiooTyBAMDa34L+spwsKuK/KxqusfIwhUiudamwQEO/wUTf8kPInujstho24FharspFIqdn/7mX+Fd8wvkB2FKkESOxD8uzJgNhYyHhArruHSEXQlyv7Qs3FlJBuDislw==',key_name='tempest-keypair-1043338373',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='554876e2455347ea8587eab6d9a5e72a',ramdisk_id='',reservation_id='r-istarf3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1321113087',owner_user_name='tempest-ServerActionsV293TestJSON-1321113087-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5ae3fcc46c4fd1834660eb48910332',uuid=c14698a2-4375-4eff-b590-da9bd6b705c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converting VIF {"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_vif [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap790cd537-de, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5001b841-a877-41da-b5b2-050437a46cad) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:34 user nova-compute[76049]: INFO os_vif [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de')
Nov 15 11:11:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:34 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[410cca11-f368-483e-88c7-4bb7a08664c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:11:34 user nova-compute[76049]: No targets found.
Nov 15 11:11:34 user nova-compute[76049]: iSNS:
Nov 15 11:11:34 user nova-compute[76049]: No targets found.
Nov 15 11:11:34 user nova-compute[76049]: STATIC:
Nov 15 11:11:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816
Nov 15 11:11:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:11:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:11:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:11:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:11:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:11:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:11:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:34 user nova-compute[76049]: FIRMWARE:
Nov 15 11:11:34 user nova-compute[76049]: No targets found.
Nov 15 11:11:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:11:34 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:11:34 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17afe5c-071c-4568-8afe-00b90b01edcf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76b3f20-c48e-4095-88aa-4a4d0b60ec00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629c0c9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:11:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[60368659-9854-45b3-bdbb-23e6aad1a521]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5672ae06-1a8a-4d58-a627-5cbe502397c2]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6885d18e-2e31-41ec-be4f-1c6eeeea22ce]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[001da039-f6f9-429d-adf1-92fe95d5f0a8]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7763c65c-4229d2af5cf85dc6', '/dev/disk/by-id/scsi-23432323964326166', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7763c65c') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab952b4f-a0d8-41d4-b9d6-a516629dc791]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e5a41f-24bd-4b98-a54c-5ebc2b92ed95]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d87471e-5662-4011-9a0c-2ce1ad377fc3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]
Nov 15 11:11:35 user nova-compute[76049]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f319ba-4bcc-4fd6-965a-eccea077f626]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] <== disconnect_volume: return (396ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:11:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Deleting instance files /opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3_del
Nov 15 11:11:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Deletion of /opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3_del complete
Nov 15 11:11:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Successfully created port: b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:11:35 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c14698a2-4375-4eff-b590-da9bd6b705c3 could not be found.
Nov 15 11:11:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea7877-5786-4788-b7d0-911b15e4aab0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:11:35 user nova-compute[76049]: No targets found.
Nov 15 11:11:35 user nova-compute[76049]: iSNS:
Nov 15 11:11:35 user nova-compute[76049]: No targets found.
Nov 15 11:11:35 user nova-compute[76049]: STATIC:
Nov 15 11:11:35 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816
Nov 15 11:11:35 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:35 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:35 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:11:35 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:35 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:35 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:11:35 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:35 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:35 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:11:35 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:35 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:35 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:11:35 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:35 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:35 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:11:35 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:11:35 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:11:35 user nova-compute[76049]: FIRMWARE:
Nov 15 11:11:35 user nova-compute[76049]: No targets found.
Nov 15 11:11:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:11:35 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:11:35 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29fd29d-5a48-4270-80fc-e39e9ffd247f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[58449b9f-6887-44ec-b7f0-e7375acd9512]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629f0244c0>, {}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Disconnecting from: [] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] <== disconnect_volume: return (82ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgjYNXlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:35 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:11:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Successfully updated port: b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquired lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[354a8b75-34de-4073-84a4-394080863d96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:11:35 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-changed-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Refreshing instance network info cache due to event network-changed-b186c509-ea79-43d5-99f1-5dd2cf32ff58. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] Acquiring lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.148s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f92140-482b-4bd8-9f87-ce21ec2146f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4] added
Nov 15 11:11:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[264e835c-7791-478a-a5ad-b6e0e8327e1c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[243b322b-2990-4028-890a-ee1975408c77]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LgjYNXlw {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LgjYNXlw" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2879f35-10e3-4a63-bd84-07141b52e16f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LgjYNXlw'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.138s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf9a5b1-1948-49f4-9abe-1426369f6790]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c43b6-9712-442f-9c03-3e3bf51974bd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[330021a0-2e8f-46ff-a720-16d48844e54c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260]
Nov 15 11:11:36 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.127s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc734ae9-5fcc-46b0-8e23-82caa3dc3d13]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca23b880-19e6-4350-84c4-a4f036548711]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.762s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Releasing lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] Acquired lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.network.neutron [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Refreshing network info cache for port b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-23174ae7-5fb9-4306-9753-8a3092afa1f8 req-6a6f2494-3a2d-4095-a7e1-8f8c88382001 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23174ae7-5fb9-4306-9753-8a3092afa1f8 req-6a6f2494-3a2d-4095-a7e1-8f8c88382001 service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23174ae7-5fb9-4306-9753-8a3092afa1f8 req-6a6f2494-3a2d-4095-a7e1-8f8c88382001 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23174ae7-5fb9-4306-9753-8a3092afa1f8 req-6a6f2494-3a2d-4095-a7e1-8f8c88382001 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-23174ae7-5fb9-4306-9753-8a3092afa1f8 req-6a6f2494-3a2d-4095-a7e1-8f8c88382001 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:36 user nova-compute[76049]: WARNING nova.compute.manager [req-23174ae7-5fb9-4306-9753-8a3092afa1f8 req-6a6f2494-3a2d-4095-a7e1-8f8c88382001 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received unexpected event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with vm_state active and task_state rebuilding.
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converting VIF {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_vif [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad410d49-6120-4418-9542-3c473b0e991e]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgjYNXlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f66b2120-fc2b-5bd5-8193-82ab6d9ad38a', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb186c509-ea, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb186c509-ea, col_values=(('qos', UUID('d8df6894-d9be-4444-970d-f2f80d8e3576')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb186c509-ea, col_values=(('external_ids', {'iface-id': 'b186c509-ea79-43d5-99f1-5dd2cf32ff58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:b4:19', 'vm-uuid': '60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: INFO os_vif [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea')
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converting VIF {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] attach device xml: <interface type="ethernet">
Nov 15 11:11:36 user nova-compute[76049]:   <mac address="fa:16:3e:e7:b4:19"/>
Nov 15 11:11:36 user nova-compute[76049]:   <model type="virtio"/>
Nov 15 11:11:36 user nova-compute[76049]:   <mtu size="1442"/>
Nov 15 11:11:36 user nova-compute[76049]:   <target dev="tapb186c509-ea"/>
Nov 15 11:11:36 user nova-compute[76049]: </interface>
Nov 15 11:11:36 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Preparing to wait for external event volume-reimaged-1ade6fb4-0436-483a-b3b0-fb4a90adc4df {{(pid=76049) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No BDM found with device name hda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No VIF found with MAC fa:16:3e:da:28:bc, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:11:37 user nova-compute[76049]:   <nova:package version="0.0.0"/>
Nov 15 11:11:37 user nova-compute[76049]:   <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:11:37 user nova-compute[76049]:   <nova:creationTime>2023-11-15 11:11:37</nova:creationTime>
Nov 15 11:11:37 user nova-compute[76049]:   <nova:flavor name="m1.tiny">
Nov 15 11:11:37 user nova-compute[76049]:     <nova:memory>512</nova:memory>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:disk>1</nova:disk>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:swap>0</nova:swap>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:vcpus>1</nova:vcpus>
Nov 15 11:11:37 user nova-compute[76049]:   </nova:flavor>
Nov 15 11:11:37 user nova-compute[76049]:   <nova:owner>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:11:37 user nova-compute[76049]:   </nova:owner>
Nov 15 11:11:37 user nova-compute[76049]:   <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:11:37 user nova-compute[76049]:   <nova:ports>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:11:37 user nova-compute[76049]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:11:37 user nova-compute[76049]:     </nova:port>
Nov 15 11:11:37 user nova-compute[76049]:     <nova:port uuid="b186c509-ea79-43d5-99f1-5dd2cf32ff58">
Nov 15 11:11:37 user nova-compute[76049]:       <nova:ip type="fixed" address="10.10.10.234" ipVersion="4"/>
Nov 15 11:11:37 user nova-compute[76049]:     </nova:port>
Nov 15 11:11:37 user nova-compute[76049]:   </nova:ports>
Nov 15 11:11:37 user nova-compute[76049]: </nova:instance>
Nov 15 11:11:37 user nova-compute[76049]:  {{(pid=76049) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d106c87c-5a0c-422d-9355-a1e0d9957831 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "interface-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.843s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'flavor' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.801s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] <== connect_volume: return (1803ms) {'type': 'block', 'scsi_wwn': '26236643231326561', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236643231326561', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.network.neutron [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updated VIF entry in instance network info cache for port b186c509-ea79-43d5-99f1-5dd2cf32ff58. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.network.neutron [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lazy-loading 'flavor' on Instance uuid cc582aae-00f7-4c3d-b551-a70aac92d7ac {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e888a01a-238f-4ce2-8dea-41cdff84edae req-20ccb62f-15bf-4484-8559-44cf4c73ada6 service nova] Releasing lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:11:37 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:37 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:11:37 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:37 user nova-compute[76049]:   <serial>3132fdd8-803a-43e9-9995-80107931eee4</serial>
Nov 15 11:11:37 user nova-compute[76049]: </disk>
Nov 15 11:11:37 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:37 user nova-compute[76049]: INFO nova.compute.manager [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Attaching volume f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 to /dev/vdb
Nov 15 11:11:37 user nova-compute[76049]: DEBUG os_brick.utils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[af72f217-2953-4ef6-bcb4-99e0bef42963]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[986b7db4-75e5-451a-a8e4-7953298f4f0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[13030fe7-76c9-45be-80e5-8fed56554b72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07aa9e7-3034-45ae-a833-67afd4986898]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:37 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:11:37 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac69444-c068-4cb0-b155-898e1c9c62e6]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.utils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating existing volume attachment record: f6ea0321-afc0-448b-b22b-cb5e8cf89b7f {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:38 user nova-compute[76049]: WARNING nova.compute.manager [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received unexpected event network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 for instance with vm_state active and task_state None.
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:38 user nova-compute[76049]: WARNING nova.compute.manager [req-c181235a-058c-490d-8421-e006ce3c3e57 req-afad184d-7e7f-4746-a22c-1e8e77804fa8 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received unexpected event network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 for instance with vm_state active and task_state None.
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] No VIF found with MAC fa:16:3e:f7:b6:6c, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d6c33881-3582-4ec4-b80c-e0bc4644e36d tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.099s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTHDAUWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:38 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[54874f66-c52e-47de-8fe3-ecc7825bbbb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:11:38 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1778d68-6952-4246-9e3a-7716c7becbfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb] added
Nov 15 11:11:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e462c25-f51f-46b3-9718-09320d15449d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e45a83-a838-41b3-a390-5780bc0f756e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTHDAUWG {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTHDAUWG" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6801cc-4698-42ee-931c-94723eb67215]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tTHDAUWG'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee49c3d-1200-4d9c-8033-8946ea970a07]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee88dee-83c6-4e0c-8a90-9b4a615bfc4d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[516c8d08-6535-468d-beac-d992825f7fde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260]
Nov 15 11:11:38 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea839081-57e1-40c9-956b-2df41cca762b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa59d20-ea5a-4794-861f-b824aaf8b5ea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0393d2-4688-4f81-bb02-686ff315db68]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:11:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTHDAUWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:39 user nova-compute[76049]: INFO nova.compute.manager [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Detaching volume 3132fdd8-803a-43e9-9995-80107931eee4
Nov 15 11:11:39 user nova-compute[76049]: INFO nova.virt.block_device [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Attempting to driver detach volume 3132fdd8-803a-43e9-9995-80107931eee4 from mountpoint /dev/vdb
Nov 15 11:11:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Attempting to detach device vdb from instance cc582aae-00f7-4c3d-b551-a70aac92d7ac from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:39 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:39 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:11:39 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:39 user nova-compute[76049]:   <serial>3132fdd8-803a-43e9-9995-80107931eee4</serial>
Nov 15 11:11:39 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:11:39 user nova-compute[76049]: </disk>
Nov 15 11:11:39 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Successfully detached device vdb from instance cc582aae-00f7-4c3d-b551-a70aac92d7ac from the persistent domain config.
Nov 15 11:11:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc582aae-00f7-4c3d-b551-a70aac92d7ac from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:39 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:39 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:11:39 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:39 user nova-compute[76049]:   <serial>3132fdd8-803a-43e9-9995-80107931eee4</serial>
Nov 15 11:11:39 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:11:39 user nova-compute[76049]: </disk>
Nov 15 11:11:39 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26664313730646336', 'path': '/dev/sdi'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664313730646336', 'path': '/dev/sdi'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lazy-loading 'flavor' on Instance uuid a920e6ce-95d2-445c-b485-548da3d81042 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:11:39 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:39 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:11:39 user nova-compute[76049]:   <target dev="sdc" bus="scsi"/>
Nov 15 11:11:39 user nova-compute[76049]:   <serial>15253af8-4ab6-4c15-ae25-ce337851c2eb</serial>
Nov 15 11:11:39 user nova-compute[76049]:   <address type="drive" controller="0" unit="2"/>
Nov 15 11:11:39 user nova-compute[76049]: </disk>
Nov 15 11:11:39 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:11:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] No BDM found with device name sda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] No BDM found with device name sdc, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] No VIF found with MAC fa:16:3e:ec:70:83, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:11:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f831ccf1-8a57-45d6-803d-0914ec1ad811 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc582aae-00f7-4c3d-b551-a70aac92d7ac {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:41 user nova-compute[76049]: INFO nova.compute.manager [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Detaching volume 15253af8-4ab6-4c15-ae25-ce337851c2eb
Nov 15 11:11:41 user nova-compute[76049]: INFO nova.virt.block_device [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Attempting to driver detach volume 15253af8-4ab6-4c15-ae25-ce337851c2eb from mountpoint /dev/sdc
Nov 15 11:11:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Attempting to detach device sdc from instance a920e6ce-95d2-445c-b485-548da3d81042 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:41 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:41 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:11:41 user nova-compute[76049]:   <target dev="sdc" bus="scsi"/>
Nov 15 11:11:41 user nova-compute[76049]:   <serial>15253af8-4ab6-4c15-ae25-ce337851c2eb</serial>
Nov 15 11:11:41 user nova-compute[76049]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 11:11:41 user nova-compute[76049]: </disk>
Nov 15 11:11:41 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Successfully detached device sdc from instance a920e6ce-95d2-445c-b485-548da3d81042 from the persistent domain config.
Nov 15 11:11:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance a920e6ce-95d2-445c-b485-548da3d81042 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:41 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:41 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:11:41 user nova-compute[76049]:   <target dev="sdc" bus="scsi"/>
Nov 15 11:11:41 user nova-compute[76049]:   <serial>15253af8-4ab6-4c15-ae25-ce337851c2eb</serial>
Nov 15 11:11:41 user nova-compute[76049]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 11:11:41 user nova-compute[76049]: </disk>
Nov 15 11:11:41 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance a920e6ce-95d2-445c-b485-548da3d81042 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:41 user nova-compute[76049]: INFO nova.compute.manager [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Terminating instance
Nov 15 11:11:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-3a222c39-a961-4cb2-94e0-aff7ec78f0d8 req-7a0c0401-b5cc-47a4-88f3-5d2cecc10e6e service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received event network-vif-unplugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3a222c39-a961-4cb2-94e0-aff7ec78f0d8 req-7a0c0401-b5cc-47a4-88f3-5d2cecc10e6e service nova] Acquiring lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3a222c39-a961-4cb2-94e0-aff7ec78f0d8 req-7a0c0401-b5cc-47a4-88f3-5d2cecc10e6e service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3a222c39-a961-4cb2-94e0-aff7ec78f0d8 req-7a0c0401-b5cc-47a4-88f3-5d2cecc10e6e service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-3a222c39-a961-4cb2-94e0-aff7ec78f0d8 req-7a0c0401-b5cc-47a4-88f3-5d2cecc10e6e service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] No waiting events found dispatching network-vif-unplugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-3a222c39-a961-4cb2-94e0-aff7ec78f0d8 req-7a0c0401-b5cc-47a4-88f3-5d2cecc10e6e service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received event network-vif-unplugged-1dff976f-9c20-4915-aeca-1baac9b43a0a for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:11:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Instance destroyed successfully.
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lazy-loading 'resources' on Instance uuid a839d9dc-b17f-421b-ac5e-6a22cffd10fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1342677441',display_name='tempest-VolumesNegativeTest-instance-1342677441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1342677441',id=7,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97ade19cfa6249d5939ab07e413a9466',ramdisk_id='',reservation_id='r-zysygraf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1965965135',owner_user_name='tempest-VolumesNegativeTest-1965965135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:04Z,user_data=None,user_id='d6cbd6f62ba045688364e0241df4fdbd',uuid=a839d9dc-b17f-421b-ac5e-6a22cffd10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Converting VIF {"id": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "address": "fa:16:3e:79:86:9a", "network": {"id": "250f6248-34e4-4fb4-b4df-3aa0ccaae93f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85ce1f2d692f4b71b461029ac1dfdbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dff976f-9c", "ovs_interfaceid": "1dff976f-9c20-4915-aeca-1baac9b43a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:9a,bridge_name='br-int',has_traffic_filtering=True,id=1dff976f-9c20-4915-aeca-1baac9b43a0a,network=Network(250f6248-34e4-4fb4-b4df-3aa0ccaae93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dff976f-9c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG os_vif [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:9a,bridge_name='br-int',has_traffic_filtering=True,id=1dff976f-9c20-4915-aeca-1baac9b43a0a,network=Network(250f6248-34e4-4fb4-b4df-3aa0ccaae93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dff976f-9c') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dff976f-9c, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=480ac60b-fc45-4c74-ab41-8a581626d2a3) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:42 user nova-compute[76049]: INFO os_vif [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:9a,bridge_name='br-int',has_traffic_filtering=True,id=1dff976f-9c20-4915-aeca-1baac9b43a0a,network=Network(250f6248-34e4-4fb4-b4df-3aa0ccaae93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dff976f-9c')
Nov 15 11:11:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Deleting instance files /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa_del
Nov 15 11:11:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Deletion of /opt/stack/data/nova/instances/a839d9dc-b17f-421b-ac5e-6a22cffd10fa_del complete
Nov 15 11:11:42 user nova-compute[76049]: INFO nova.compute.manager [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 11:11:42 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:11:42 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnQHNGxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:43 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:43 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:43 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a07246f-2591-4478-94c6-f1db4ece0822]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:11:43 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5faa27b-8f84-4ac1-827c-6be77771d98a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77] added
Nov 15 11:11:43 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a904321-0a29-458b-ba4a-a0cf16f494e4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:43 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Took 0.52 seconds to deallocate network for instance.
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[da03bea9-5da4-44d9-9cb2-d7e7d85d1ad5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnQHNGxb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnQHNGxb" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f783ec4-dd34-4c53-8918-8edaa31ed3d8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZnQHNGxb'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d00a0d9-225c-477a-a149-58f2155a182c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e81fdb8-b32f-4b8f-9820-136b5c8db54c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[34219202-6369-4e34-9fcb-42bcd30acb4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260]
Nov 15 11:11:43 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:43 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef6c6d7-feed-4da7-9bc7-544ee9edb597]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7950fa-e529-4195-8f53-4620dadb8a8c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:43 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab0e504-28dd-49be-878b-a4c3ac2aa7a3]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnQHNGxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:43 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Deleted allocations for instance a839d9dc-b17f-421b-ac5e-6a22cffd10fa
Nov 15 11:11:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76a7a876-0cd6-4a77-a402-adc119e4352b tempest-VolumesNegativeTest-1965965135 tempest-VolumesNegativeTest-1965965135-project-member] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.933s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-0536ec76-98d7-4799-a4c2-bf65a8daa6a7 req-cced11a6-bcd3-4684-ac07-eb0d8968709a service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received event network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0536ec76-98d7-4799-a4c2-bf65a8daa6a7 req-cced11a6-bcd3-4684-ac07-eb0d8968709a service nova] Acquiring lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0536ec76-98d7-4799-a4c2-bf65a8daa6a7 req-cced11a6-bcd3-4684-ac07-eb0d8968709a service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0536ec76-98d7-4799-a4c2-bf65a8daa6a7 req-cced11a6-bcd3-4684-ac07-eb0d8968709a service nova] Lock "a839d9dc-b17f-421b-ac5e-6a22cffd10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-0536ec76-98d7-4799-a4c2-bf65a8daa6a7 req-cced11a6-bcd3-4684-ac07-eb0d8968709a service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] No waiting events found dispatching network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:44 user nova-compute[76049]: WARNING nova.compute.manager [req-0536ec76-98d7-4799-a4c2-bf65a8daa6a7 req-cced11a6-bcd3-4684-ac07-eb0d8968709a service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received unexpected event network-vif-plugged-1dff976f-9c20-4915-aeca-1baac9b43a0a for instance with vm_state deleted and task_state None.
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-0536ec76-98d7-4799-a4c2-bf65a8daa6a7 req-cced11a6-bcd3-4684-ac07-eb0d8968709a service nova] [instance: a839d9dc-b17f-421b-ac5e-6a22cffd10fa] Received event network-vif-deleted-1dff976f-9c20-4915-aeca-1baac9b43a0a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26434656633396262', 'path': '/dev/sdk'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434656633396262', 'path': '/dev/sdk'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.objects.instance [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'flavor' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:11:44 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:44 user nova-compute[76049]:   <source dev="/dev/sdk"/>
Nov 15 11:11:44 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:44 user nova-compute[76049]:   <serial>f0034cf7-46b8-4cc1-98d4-cb75c5a34b77</serial>
Nov 15 11:11:44 user nova-compute[76049]: </disk>
Nov 15 11:11:44 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No BDM found with device name hda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] No VIF found with MAC fa:16:3e:da:28:bc, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:11:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-945c7613-3ff2-4f93-8ddf-5c5ae262553b tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.333s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:46 user nova-compute[76049]: INFO nova.compute.manager [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Detaching volume f0034cf7-46b8-4cc1-98d4-cb75c5a34b77
Nov 15 11:11:46 user nova-compute[76049]: INFO nova.virt.block_device [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Attempting to driver detach volume f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 from mountpoint /dev/vdb
Nov 15 11:11:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Attempting to detach device vdb from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:11:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:46 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:46 user nova-compute[76049]:   <source dev="/dev/sdk"/>
Nov 15 11:11:46 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:46 user nova-compute[76049]:   <serial>f0034cf7-46b8-4cc1-98d4-cb75c5a34b77</serial>
Nov 15 11:11:46 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 11:11:46 user nova-compute[76049]: </disk>
Nov 15 11:11:46 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:46 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully detached device vdb from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the persistent domain config.
Nov 15 11:11:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:11:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:46 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:46 user nova-compute[76049]:   <source dev="/dev/sdk"/>
Nov 15 11:11:46 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:46 user nova-compute[76049]:   <serial>f0034cf7-46b8-4cc1-98d4-cb75c5a34b77</serial>
Nov 15 11:11:46 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 11:11:46 user nova-compute[76049]: </disk>
Nov 15 11:11:46 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:11:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-changed-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Refreshing instance network info cache due to event network-changed-04aa0913-1b50-4e1e-a854-8a97253bee1d. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] Acquiring lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] Acquired lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Refreshing network info cache for port 04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "8a944329-f077-4be4-b780-492b9e9d978d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG nova.objects.instance [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lazy-loading 'flavor' on Instance uuid 8a944329-f077-4be4-b780-492b9e9d978d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "8a944329-f077-4be4-b780-492b9e9d978d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.180s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Updated VIF entry in instance network info cache for port 04aa0913-1b50-4e1e-a854-8a97253bee1d. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Updating instance_info_cache with network_info: [{"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7b68daed-1a82-4284-a45f-21255d6a7f88 req-cfc7c9d4-e9c1-487a-b95a-6b16704dc7f9 service nova] Releasing lock "refresh_cache-8a944329-f077-4be4-b780-492b9e9d978d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "8a944329-f077-4be4-b780-492b9e9d978d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:47 user nova-compute[76049]: INFO nova.compute.manager [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Attaching volume e6531b01-3157-41fe-a422-86545cdbb8ac to /dev/vdb
Nov 15 11:11:48 user nova-compute[76049]: DEBUG os_brick.utils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30706c1-cfb4-4538-8938-97a82acae1bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[036d293b-9a84-4a11-9e59-f139eb4e9df9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2817e2-1c72-43d0-9b24-4526649599fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f2f6b4-e4cb-4413-94f0-98a58c990fad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:48 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:11:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[879dbf11-7f2c-4154-b593-f7792eb26a3d]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG os_brick.utils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:48 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Updating existing volume attachment record: 067456dd-15ee-48ce-92c6-00a700bee74c {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b523a43-542a-4264-95ec-93439b24c4ee req-5b47c00d-4667-4496-b8f6-acd11c240f2c service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event volume-reimaged-1ade6fb4-0436-483a-b3b0-fb4a90adc4df {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b523a43-542a-4264-95ec-93439b24c4ee req-5b47c00d-4667-4496-b8f6-acd11c240f2c service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b523a43-542a-4264-95ec-93439b24c4ee req-5b47c00d-4667-4496-b8f6-acd11c240f2c service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b523a43-542a-4264-95ec-93439b24c4ee req-5b47c00d-4667-4496-b8f6-acd11c240f2c service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b523a43-542a-4264-95ec-93439b24c4ee req-5b47c00d-4667-4496-b8f6-acd11c240f2c service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Processing event volume-reimaged-1ade6fb4-0436-483a-b3b0-fb4a90adc4df {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:11:50 user nova-compute[76049]: INFO nova.virt.block_device [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Booting with volume 1ade6fb4-0436-483a-b3b0-fb4a90adc4df at /dev/vda
Nov 15 11:11:50 user nova-compute[76049]: DEBUG os_brick.utils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[88468d4a-caf0-4b05-b0a6-afdae401fe8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e505157-fd93-4347-85c7-1f28020e8d3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a242d71f-dac7-4561-aec7-5bdd005c398c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ed7f3f-f830-4744-95b5-a13a0ca11f0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:11:50 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:11:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[285c72e3-2d1c-4a09-a618-820bb2f8867b]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG os_brick.utils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:50 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updating existing volume attachment record: 69b426ce-37bf-4a3b-bfbd-37c327c155ba {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:11:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRSYtLWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:53 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:53 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:53 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5f2c71-6994-4eaf-8205-76f37353536a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:11:53 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca82608-32b2-49ab-833c-c375d4d29e0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac] added
Nov 15 11:11:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0993483d-a882-47dc-b155-b4d79210a127]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9497a44-4d90-4532-bdbb-80e995869a74]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRSYtLWe {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRSYtLWe" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eef366-59c7-47b2-97e1-853c8486e2f6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRSYtLWe'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cb6b3e-faa1-47fe-89eb-6305a54d08a7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebadbb1b-6054-4bb7-b402-58a1b4e56522]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa28860-f8aa-4979-91a9-9d63ee8d0fa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260]
Nov 15 11:11:53 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d9327-1901-4835-acf0-1683abe4df38]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9750c559-e522-4f6a-b113-86a001a97093]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2933203-4e20-4606-89d6-851b95841429]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:11:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRSYtLWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:11:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26135356166383733', 'path': '/dev/sdj'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135356166383733', 'path': '/dev/sdj'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:11:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lazy-loading 'flavor' on Instance uuid 8a944329-f077-4be4-b780-492b9e9d978d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 11:11:54 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:54 user nova-compute[76049]:   <source dev="/dev/sdj"/>
Nov 15 11:11:54 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:54 user nova-compute[76049]:   <serial>e6531b01-3157-41fe-a422-86545cdbb8ac</serial>
Nov 15 11:11:54 user nova-compute[76049]: </disk>
Nov 15 11:11:54 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] No VIF found with MAC fa:16:3e:c4:1f:9b, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-08caefa9-055f-4282-a6aa-a1ceab2383b8 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "8a944329-f077-4be4-b780-492b9e9d978d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.515s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] volume_snapshot_create: create_info: {'snapshot_id': 'fcb1e062-da97-42ae-a93a-288a7a0c700c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=76049) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] snap xml: <domainsnapshot>
Nov 15 11:11:55 user nova-compute[76049]:   <disks>
Nov 15 11:11:55 user nova-compute[76049]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 15 11:11:55 user nova-compute[76049]:       <source file="/dev/new_file"/>
Nov 15 11:11:55 user nova-compute[76049]:     </disk>
Nov 15 11:11:55 user nova-compute[76049]:     <disk name="vda" snapshot="no"/>
Nov 15 11:11:55 user nova-compute[76049]:   </disks>
Nov 15 11:11:55 user nova-compute[76049]: </domainsnapshot>
Nov 15 11:11:55 user nova-compute[76049]:  {{(pid=76049) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG nova.objects.instance [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] Lazy-loading 'system_metadata' on Instance uuid 8a944329-f077-4be4-b780-492b9e9d978d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8653ba27-4041-4fbf-86ef-debe49f94981 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] volume_snapshot_delete: delete_info: {'volume_id': 'e6531b01-3157-41fe-a422-86545cdbb8ac'} {{(pid=76049) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [None req-8653ba27-4041-4fbf-86ef-debe49f94981 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     if delete_info['type'] != 'qcow2':
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] KeyError: 'type'
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [None req-8653ba27-4041-4fbf-86ef-debe49f94981 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ee7f15bc-9647-48c2-b381-2a098d79577c)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server [None req-8653ba27-4041-4fbf-86ef-debe49f94981 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] Exception during message handling: KeyError: 'type'
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     rv = execute(f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     six.reraise(c, e, tb)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     raise value
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     rv = meth(*args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     self._volume_snapshot_create(context, instance, guest,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     rv = execute(f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     six.reraise(c, e, tb)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     raise value
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     rv = meth(*args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [instance: 8a944329-f077-4be4-b780-492b9e9d978d] 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot fcb1e062-da97-42ae-a93a-288a7a0c700c could not be found.
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot fcb1e062-da97-42ae-a93a-288a7a0c700c could not be found. (HTTP 404) (Request-ID: req-bfdcfdec-f26a-4f39-8340-e9d5622d5ef4)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot fcb1e062-da97-42ae-a93a-288a7a0c700c could not be found.
Nov 15 11:11:55 user nova-compute[76049]: ERROR nova.virt.libvirt.driver 
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server [None req-2d83101c-7439-435d-a0ec-c04411203ce2 tempest-VolumesAssistedSnapshotsTest-1432847779 tempest-VolumesAssistedSnapshotsTest-1432847779-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 11:11:55 user nova-compute[76049]: ERROR oslo_messaging.rpc.server 
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:11:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Creating image(s)
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Ensure instance console log exists: /opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Start _get_guest_xml network_info=[{"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c14698a2-4375-4eff-b590-da9bd6b705c3', 'attached_at': '', 'detached_at': '', 'volume_id': '1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'serial': '1ade6fb4-0436-483a-b3b0-fb4a90adc4df'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '69b426ce-37bf-4a3b-bfbd-37c327c155ba', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "8a944329-f077-4be4-b780-492b9e9d978d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 11:11:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lazy-loading 'vcpu_model' on Instance uuid c14698a2-4375-4eff-b590-da9bd6b705c3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:56 user nova-compute[76049]: INFO nova.compute.manager [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Detaching volume e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:11:56 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:56 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:11:56 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: INFO nova.virt.block_device [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Attempting to driver detach volume e6531b01-3157-41fe-a422-86545cdbb8ac from mountpoint /dev/vdb
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b2eb8f-0588-427b-bb98-e790fde66843]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:11:56 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Attempting to detach device vdb from instance 8a944329-f077-4be4-b780-492b9e9d978d from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:56 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:56 user nova-compute[76049]:   <source dev="/dev/sdj"/>
Nov 15 11:11:56 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:56 user nova-compute[76049]:   <serial>e6531b01-3157-41fe-a422-86545cdbb8ac</serial>
Nov 15 11:11:56 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:11:56 user nova-compute[76049]: </disk>
Nov 15 11:11:56 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Successfully detached device vdb from instance 8a944329-f077-4be4-b780-492b9e9d978d from the persistent domain config.
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a944329-f077-4be4-b780-492b9e9d978d from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 11:11:56 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:56 user nova-compute[76049]:   <source dev="/dev/sdj"/>
Nov 15 11:11:56 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:11:56 user nova-compute[76049]:   <serial>e6531b01-3157-41fe-a422-86545cdbb8ac</serial>
Nov 15 11:11:56 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:11:56 user nova-compute[76049]: </disk>
Nov 15 11:11:56 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0407242b-dcf4-47c6-9ad4-fc37b66c4b3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df] added
Nov 15 11:11:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e824ba-b6dc-40ea-bdf8-03e7dc28bc99]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc518ff1-340e-446d-bb99-81d6601f01cb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilEkYyuJ {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilEkYyuJ" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20e082c-074b-4b1e-b9b1-0d6ece429e3d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ilEkYyuJ'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8724fd5-0be0-4b4b-94a0-bff99391d027]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[26693ef3-10fc-4a5f-9850-014ed3570d69]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1421dcac-4977-48f0-9b1e-00f386a0da14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]
Nov 15 11:11:56 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.
Nov 15 11:11:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199ac8b-eccf-4ad1-8cf1-5f487949501c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d0d7f-8fbd-47b2-bc5f-72ab633cc0d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:11:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] HCTL ('43', '-', '-', 0) found on session 15 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c327b-7d14-40c5-b034-2406eff0ffa1]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a944329-f077-4be4-b780-492b9e9d978d {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23432323964326166', 'path': '/dev/sdl'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432323964326166', 'path': '/dev/sdl'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1903236133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455564423',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiooTyBAMDa34L+spwsKuK/KxqusfIwhUiudamwQEO/wUTf8kPInujstho24FharspFIqdn/7mX+Fd8wvkB2FKkESOxD8uzJgNhYyHhArruHSEXQlyv7Qs3FlJBuDislw==',key_name='tempest-keypair-1043338373',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='554876e2455347ea8587eab6d9a5e72a',ramdisk_id='',reservation_id='r-istarf3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1321113087',owner_user_name='tempest-ServerActionsV293TestJSON-1321113087-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5ae3fcc46c4fd1834660eb48910332',uuid=c14698a2-4375-4eff-b590-da9bd6b705c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converting VIF {"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:11:57 user nova-compute[76049]:   <uuid>c14698a2-4375-4eff-b590-da9bd6b705c3</uuid>
Nov 15 11:11:57 user nova-compute[76049]:   <name>instance-00000005</name>
Nov 15 11:11:57 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:11:57 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:11:57 user nova-compute[76049]:   <metadata>
Nov 15 11:11:57 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:11:57 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:11:57 user nova-compute[76049]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1903236133</nova:name>
Nov 15 11:11:57 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:11:56</nova:creationTime>
Nov 15 11:11:57 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:11:57 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:11:57 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:11:57 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:11:57 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:11:57 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:11:57 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:11:57 user nova-compute[76049]:       <nova:owner>
Nov 15 11:11:57 user nova-compute[76049]:         <nova:user uuid="9e5ae3fcc46c4fd1834660eb48910332">tempest-ServerActionsV293TestJSON-1321113087-project-member</nova:user>
Nov 15 11:11:57 user nova-compute[76049]:         <nova:project uuid="554876e2455347ea8587eab6d9a5e72a">tempest-ServerActionsV293TestJSON-1321113087</nova:project>
Nov 15 11:11:57 user nova-compute[76049]:       </nova:owner>
Nov 15 11:11:57 user nova-compute[76049]:       <nova:ports>
Nov 15 11:11:57 user nova-compute[76049]:         <nova:port uuid="790cd537-de81-4c38-b956-e7844fe08df4">
Nov 15 11:11:57 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:11:57 user nova-compute[76049]:         </nova:port>
Nov 15 11:11:57 user nova-compute[76049]:       </nova:ports>
Nov 15 11:11:57 user nova-compute[76049]:     </nova:instance>
Nov 15 11:11:57 user nova-compute[76049]:   </metadata>
Nov 15 11:11:57 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:11:57 user nova-compute[76049]:     <system>
Nov 15 11:11:57 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:11:57 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:11:57 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:11:57 user nova-compute[76049]:       <entry name="serial">c14698a2-4375-4eff-b590-da9bd6b705c3</entry>
Nov 15 11:11:57 user nova-compute[76049]:       <entry name="uuid">c14698a2-4375-4eff-b590-da9bd6b705c3</entry>
Nov 15 11:11:57 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:11:57 user nova-compute[76049]:     </system>
Nov 15 11:11:57 user nova-compute[76049]:   </sysinfo>
Nov 15 11:11:57 user nova-compute[76049]:   <os>
Nov 15 11:11:57 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:11:57 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:11:57 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:11:57 user nova-compute[76049]:   </os>
Nov 15 11:11:57 user nova-compute[76049]:   <features>
Nov 15 11:11:57 user nova-compute[76049]:     <acpi/>
Nov 15 11:11:57 user nova-compute[76049]:     <apic/>
Nov 15 11:11:57 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:11:57 user nova-compute[76049]:   </features>
Nov 15 11:11:57 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:11:57 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:11:57 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:11:57 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:11:57 user nova-compute[76049]:   </clock>
Nov 15 11:11:57 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:11:57 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:11:57 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:11:57 user nova-compute[76049]:   </cpu>
Nov 15 11:11:57 user nova-compute[76049]:   <devices>
Nov 15 11:11:57 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:11:57 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:11:57 user nova-compute[76049]:       <source dev="/dev/sdl"/>
Nov 15 11:11:57 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:11:57 user nova-compute[76049]:       <serial>1ade6fb4-0436-483a-b3b0-fb4a90adc4df</serial>
Nov 15 11:11:57 user nova-compute[76049]:     </disk>
Nov 15 11:11:57 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:11:57 user nova-compute[76049]:       <mac address="fa:16:3e:b6:03:77"/>
Nov 15 11:11:57 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:11:57 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:11:57 user nova-compute[76049]:       <target dev="tap790cd537-de"/>
Nov 15 11:11:57 user nova-compute[76049]:     </interface>
Nov 15 11:11:57 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:11:57 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3/console.log" append="off"/>
Nov 15 11:11:57 user nova-compute[76049]:     </serial>
Nov 15 11:11:57 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:11:57 user nova-compute[76049]:     <video>
Nov 15 11:11:57 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:11:57 user nova-compute[76049]:     </video>
Nov 15 11:11:57 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:11:57 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:11:57 user nova-compute[76049]:     </rng>
Nov 15 11:11:57 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:11:57 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:11:57 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:11:57 user nova-compute[76049]:     </memballoon>
Nov 15 11:11:57 user nova-compute[76049]:   </devices>
Nov 15 11:11:57 user nova-compute[76049]: </domain>
Nov 15 11:11:57 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1903236133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455564423',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiooTyBAMDa34L+spwsKuK/KxqusfIwhUiudamwQEO/wUTf8kPInujstho24FharspFIqdn/7mX+Fd8wvkB2FKkESOxD8uzJgNhYyHhArruHSEXQlyv7Qs3FlJBuDislw==',key_name='tempest-keypair-1043338373',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='554876e2455347ea8587eab6d9a5e72a',ramdisk_id='',reservation_id='r-istarf3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1321113087',owner_user_name='tempest-ServerActionsV293TestJSON-1321113087-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5ae3fcc46c4fd1834660eb48910332',uuid=c14698a2-4375-4eff-b590-da9bd6b705c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converting VIF {"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG os_vif [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f928f4d-fc1a-51c5-8bb1-9bc863e3f864', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap790cd537-de, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap790cd537-de, col_values=(('qos', UUID('f2014d3e-ddd1-4312-8937-dcb7064883aa')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap790cd537-de, col_values=(('external_ids', {'iface-id': '790cd537-de81-4c38-b956-e7844fe08df4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:03:77', 'vm-uuid': 'c14698a2-4375-4eff-b590-da9bd6b705c3'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:58 user nova-compute[76049]: INFO os_vif [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de')
Nov 15 11:11:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] No VIF found with MAC fa:16:3e:b6:03:77, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:58 user nova-compute[76049]: INFO nova.compute.manager [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Terminating instance
Nov 15 11:11:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-91a97a26-c902-4545-bf76-7a12ba673281 req-cb0b4a6b-813d-4aee-8fcc-ab3169922f41 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received event network-vif-unplugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-91a97a26-c902-4545-bf76-7a12ba673281 req-cb0b4a6b-813d-4aee-8fcc-ab3169922f41 service nova] Acquiring lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-91a97a26-c902-4545-bf76-7a12ba673281 req-cb0b4a6b-813d-4aee-8fcc-ab3169922f41 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-91a97a26-c902-4545-bf76-7a12ba673281 req-cb0b4a6b-813d-4aee-8fcc-ab3169922f41 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-91a97a26-c902-4545-bf76-7a12ba673281 req-cb0b4a6b-813d-4aee-8fcc-ab3169922f41 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] No waiting events found dispatching network-vif-unplugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-91a97a26-c902-4545-bf76-7a12ba673281 req-cb0b4a6b-813d-4aee-8fcc-ab3169922f41 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received event network-vif-unplugged-9c394109-7419-49fe-9d00-9be9babcd772 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:11:59 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Instance destroyed successfully.
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.objects.instance [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lazy-loading 'resources' on Instance uuid 6bce81ea-2634-40fe-945b-afe6c1e09a7c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-725854971',display_name='tempest-VolumesActionsTest-instance-725854971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-725854971',id=9,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e58ca5ef511414d9faadad3a3ad8279',ramdisk_id='',reservation_id='r-eg3u8kbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1276343229',owner_user_name='tempest-VolumesActionsTest-1276343229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:16Z,user_data=None,user_id='39adb4a06ee64e4ab6206842b79f5e51',uuid=6bce81ea-2634-40fe-945b-afe6c1e09a7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converting VIF {"id": "9c394109-7419-49fe-9d00-9be9babcd772", "address": "fa:16:3e:50:be:13", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c394109-74", "ovs_interfaceid": "9c394109-7419-49fe-9d00-9be9babcd772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:be:13,bridge_name='br-int',has_traffic_filtering=True,id=9c394109-7419-49fe-9d00-9be9babcd772,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c394109-74') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG os_vif [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:be:13,bridge_name='br-int',has_traffic_filtering=True,id=9c394109-7419-49fe-9d00-9be9babcd772,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c394109-74') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-changed-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing instance network info cache due to event network-changed-628847f4-3e6e-4afa-821c-7d9869e65909. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] Acquiring lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] Acquired lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Refreshing network info cache for port 628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c394109-74, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad8abe86-19c6-4655-9ed5-c3c4d0664951) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: INFO os_vif [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:be:13,bridge_name='br-int',has_traffic_filtering=True,id=9c394109-7419-49fe-9d00-9be9babcd772,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c394109-74')
Nov 15 11:11:59 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Deleting instance files /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c_del
Nov 15 11:11:59 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Deletion of /opt/stack/data/nova/instances/6bce81ea-2634-40fe-945b-afe6c1e09a7c_del complete
Nov 15 11:11:59 user nova-compute[76049]: INFO nova.compute.manager [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 11:11:59 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updated VIF entry in instance network info cache for port 628847f4-3e6e-4afa-821c-7d9869e65909. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [{"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:11:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eb11fd91-d7b3-4b00-b1b1-0b10ea9975ba req-4b0af677-5a27-4f3b-b3a6-09329d070031 service nova] Releasing lock "refresh_cache-b002ac80-978b-490c-89ed-2031b850a4e1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:00 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc582aae-00f7-4c3d-b551-a70aac92d7ac is timed out.
Nov 15 11:12:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Successfully detached device vdb from instance cc582aae-00f7-4c3d-b551-a70aac92d7ac from the live domain config.
Nov 15 11:12:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgjYNXlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:00 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a21a9d2-bd15-4251-a504-2eabb04576b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:00 user nova-compute[76049]: No targets found.
Nov 15 11:12:00 user nova-compute[76049]: iSNS:
Nov 15 11:12:00 user nova-compute[76049]: No targets found.
Nov 15 11:12:00 user nova-compute[76049]: STATIC:
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:00 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:00 user nova-compute[76049]: No targets found.
Nov 15 11:12:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:00 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:00 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67f266-63cb-42c1-bed6-0d8fadf427f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b504ee9f-8d0a-4696-bfd2-8209c77e84f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6260722830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ee9d8c-addd-44b1-b4a3-f1fab8ae5198]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1542408-68a0-46ce-b5b5-c8d90889face]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Took 1.19 seconds to deallocate network for instance.
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d49b1-d937-4ef8-b3f2-40813fe99bc9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70782a-d6a8-4b09-955b-d79c7f7ae7bf]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a639c60f-e712-470d-984a-42341d6d10b8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c759051-2f7f-4d09-9254-958bef24adf9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260]
Nov 15 11:12:00 user nova-compute[76049]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132fdd8-803a-43e9-9995-80107931eee4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[85414d7b-ea60-4b7e-aae8-6846ac64d82d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] <== disconnect_volume: return (411ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:01 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Deleted allocations for instance 6bce81ea-2634-40fe-945b-afe6c1e09a7c
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received event network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Acquiring lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] No waiting events found dispatching network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:01 user nova-compute[76049]: WARNING nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received unexpected event network-vif-plugged-9c394109-7419-49fe-9d00-9be9babcd772 for instance with vm_state deleted and task_state None.
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-changed-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing instance network info cache due to event network-changed-83e89ce0-ade3-4004-9479-ab4c18968959. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Acquiring lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Acquired lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Refreshing network info cache for port 83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-05605e9b-2ee8-407f-946b-62ada0a4dad4 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "6bce81ea-2634-40fe-945b-afe6c1e09a7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updated VIF entry in instance network info cache for port 83e89ce0-ade3-4004-9479-ab4c18968959. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [{"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:01 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance a920e6ce-95d2-445c-b485-548da3d81042 is timed out.
Nov 15 11:12:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Successfully detached device sdc from instance a920e6ce-95d2-445c-b485-548da3d81042 from the live domain config.
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTHDAUWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:01 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Releasing lock "refresh_cache-84391b07-a2b0-4053-b6d5-3d9912dcb7aa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:01 user nova-compute[76049]: WARNING nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received unexpected event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: 6bce81ea-2634-40fe-945b-afe6c1e09a7c] Received event network-vif-deleted-9c394109-7419-49fe-9d00-9be9babcd772 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:01 user nova-compute[76049]: WARNING nova.compute.manager [req-d86a6dee-d9b5-4c9a-9bd7-88a76fde03ec req-77b1081a-fc88-45a4-b76f-2e3ef5078131 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received unexpected event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6dd3fd-c22b-4c67-b1d1-c389e4057b9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:01 user nova-compute[76049]: No targets found.
Nov 15 11:12:01 user nova-compute[76049]: iSNS:
Nov 15 11:12:01 user nova-compute[76049]: No targets found.
Nov 15 11:12:01 user nova-compute[76049]: STATIC:
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:01 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:01 user nova-compute[76049]: No targets found.
Nov 15 11:12:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:01 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:01 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[218056a2-65bb-47c8-aa94-3c7beb33d7b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0851ee-8380-49d5-bc7f-08f217751417]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842ba710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb'): ({'sdi'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Removing single pathed devices sdi {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.objects.instance [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lazy-loading 'flavor' on Instance uuid cc582aae-00f7-4c3d-b551-a70aac92d7ac {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb49a2e-7561-4536-a424-2c244533efcf]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4b5b00d5-5ece-4ab6-a2d7-88ca887a74ed tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.220s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[008b71d5-9f22-48ee-9bae-ab01b49c7c68]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Flushing IO for device /dev/sdi {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6d193a-8ef4-4429-bc9b-43c12f7114a3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6093518-cdbc-45f5-9f9d-4fd9db34e77c]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[142840d4-98c3-4581-9dd9-b927f9ccbfaf]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:12:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:12:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance spawned successfully.
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb8ee1-7ea9-4e85-bd2a-e56c60f0f874]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260]
Nov 15 11:12:02 user nova-compute[76049]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15253af8-4ab6-4c15-ae25-ce337851c2eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[622554fb-d7ce-4010-87d6-2942be4f3cc5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] <== disconnect_volume: return (354ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76049) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6b523a43-542a-4264-95ec-93439b24c4ee tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:02 user nova-compute[76049]: INFO nova.compute.manager [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Terminating instance
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "b002ac80-978b-490c-89ed-2031b850a4e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:02 user nova-compute[76049]: INFO nova.compute.manager [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Terminating instance
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f77614c-e870-4c79-9e82-99d1cceb9326 req-8a1b3d74-6491-4ea0-a385-d37cb55f667b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f77614c-e870-4c79-9e82-99d1cceb9326 req-8a1b3d74-6491-4ea0-a385-d37cb55f667b service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f77614c-e870-4c79-9e82-99d1cceb9326 req-8a1b3d74-6491-4ea0-a385-d37cb55f667b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f77614c-e870-4c79-9e82-99d1cceb9326 req-8a1b3d74-6491-4ea0-a385-d37cb55f667b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f77614c-e870-4c79-9e82-99d1cceb9326 req-8a1b3d74-6491-4ea0-a385-d37cb55f667b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-unplugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f77614c-e870-4c79-9e82-99d1cceb9326 req-8a1b3d74-6491-4ea0-a385-d37cb55f667b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-628847f4-3e6e-4afa-821c-7d9869e65909 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lazy-loading 'flavor' on Instance uuid a920e6ce-95d2-445c-b485-548da3d81042 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6165fdf2-423b-49b5-825c-07f87dfd69b1 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.856s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-4517bb22-281f-4531-8832-bea15eb6012e req-6495c6cd-50fd-4192-978d-6bd983a2ad19 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4517bb22-281f-4531-8832-bea15eb6012e req-6495c6cd-50fd-4192-978d-6bd983a2ad19 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4517bb22-281f-4531-8832-bea15eb6012e req-6495c6cd-50fd-4192-978d-6bd983a2ad19 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4517bb22-281f-4531-8832-bea15eb6012e req-6495c6cd-50fd-4192-978d-6bd983a2ad19 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-4517bb22-281f-4531-8832-bea15eb6012e req-6495c6cd-50fd-4192-978d-6bd983a2ad19 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-unplugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-4517bb22-281f-4531-8832-bea15eb6012e req-6495c6cd-50fd-4192-978d-6bd983a2ad19 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-0962aed1-0769-49b5-beff-b100e4efca61 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-unplugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-83e89ce0-ade3-4004-9479-ab4c18968959 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:03 user nova-compute[76049]: WARNING nova.compute.manager [req-6779a0e2-2f61-42ac-872c-206d4016cf75 req-8ece7e98-2a12-4dc8-8c47-10db30a71edf service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-83e89ce0-ade3-4004-9479-ab4c18968959 for instance with vm_state active and task_state deleting.
Nov 15 11:12:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:04 user nova-compute[76049]: INFO nova.compute.manager [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Terminating instance
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Instance destroyed successfully.
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.objects.instance [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lazy-loading 'resources' on Instance uuid 84391b07-a2b0-4053-b6d5-3d9912dcb7aa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a7:0a,bridge_name='br-int',has_traffic_filtering=True,id=83e89ce0-ade3-4004-9479-ab4c18968959,network=Network(231c2161-ed69-4f89-b3ad-9247a1ac0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e89ce0-ad') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a7:0a,bridge_name='br-int',has_traffic_filtering=True,id=83e89ce0-ade3-4004-9479-ab4c18968959,network=Network(231c2161-ed69-4f89-b3ad-9247a1ac0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e89ce0-ad') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83e89ce0-ad, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d83db198-bdf4-4e46-8ae8-fc3518c80d01) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:04 user nova-compute[76049]: WARNING nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-628847f4-3e6e-4afa-821c-7d9869e65909 for instance with vm_state active and task_state deleting.
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-unplugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:04 user nova-compute[76049]: WARNING nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-b3ffb2ec-11af-45de-a8dc-71263904b4ad for instance with vm_state active and task_state deleting.
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-unplugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-54f92c53-94cb-4593-929e-0040324c8400 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:04 user nova-compute[76049]: WARNING nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-54f92c53-94cb-4593-929e-0040324c8400 for instance with vm_state active and task_state deleting.
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-unplugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-81a358fb-5ab5-4f2b-8551-b5db194907ed for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-fb0b7715-3099-4493-aa0a-d8ee164e6199 req-a50d4432-3243-4611-b461-8b5aac93543b service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-81a358fb-5ab5-4f2b-8551-b5db194907ed for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Instance destroyed successfully.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lazy-loading 'resources' on Instance uuid b002ac80-978b-490c-89ed-2031b850a4e1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:05 user nova-compute[76049]: INFO os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a7:0a,bridge_name='br-int',has_traffic_filtering=True,id=83e89ce0-ade3-4004-9479-ab4c18968959,network=Network(231c2161-ed69-4f89-b3ad-9247a1ac0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e89ce0-ad')
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:35:64,bridge_name='br-int',has_traffic_filtering=True,id=b3ffb2ec-11af-45de-a8dc-71263904b4ad,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3ffb2ec-11') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:35:64,bridge_name='br-int',has_traffic_filtering=True,id=b3ffb2ec-11af-45de-a8dc-71263904b4ad,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3ffb2ec-11') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3ffb2ec-11, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Instance destroyed successfully.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lazy-loading 'resources' on Instance uuid a920e6ce-95d2-445c-b485-548da3d81042 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=628847f4-3e6e-4afa-821c-7d9869e65909,network=Network(4fa5e679-abd5-4829-8971-c23eb99232a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628847f4-3e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=628847f4-3e6e-4afa-821c-7d9869e65909,network=Network(4fa5e679-abd5-4829-8971-c23eb99232a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628847f4-3e') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-6786248',display_name='tempest-AttachSCSIVolumeTestJSON-server-6786248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-6786248',id=4,image_ref='8e16a4a9-58c6-417f-943b-731a6dee758c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd8l2jjXHBwXss56Uvdf40JpWfhHoepZEMNwKQEhYuiPKaCPjam5bd7QTTIiuGAzTtWjFTHSOyme9qeHbWIiC1tK/neysg7366RH5J1+shPtivYa4m2M7aKPEr0Z+5vag==',key_name='tempest-keypair-1470040639',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0e67b1b1604fd9b8a72b6e9f8f426e',ramdisk_id='',reservation_id='r-f69tcpj0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e16a4a9-58c6-417f-943b-731a6dee758c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-846648667',owner_user_name='tempest-AttachSCSIVolumeTestJSON-846648667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='862bd9d989bc4ca586e0c65c4fdd7069',uuid=a920e6ce-95d2-445c-b485-548da3d81042,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Converting VIF {"id": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "address": "fa:16:3e:ec:70:83", "network": {"id": "cb0c0241-3e37-47a2-96d8-d8eb31c58df1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-593640564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0e67b1b1604fd9b8a72b6e9f8f426e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2067b4-33", "ovs_interfaceid": "cc2067b4-33bb-4cf7-9a0f-d7c2537308be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:70:83,bridge_name='br-int',has_traffic_filtering=True,id=cc2067b4-33bb-4cf7-9a0f-d7c2537308be,network=Network(cb0c0241-3e37-47a2-96d8-d8eb31c58df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2067b4-33') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG os_vif [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:70:83,bridge_name='br-int',has_traffic_filtering=True,id=cc2067b4-33bb-4cf7-9a0f-d7c2537308be,network=Network(cb0c0241-3e37-47a2-96d8-d8eb31c58df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2067b4-33') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-0962aed1-0769-49b5-beff-b100e4efca61 for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-unplugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-9e2778b2-2e82-437e-9b8c-64cba0c7165b for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-unplugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-unplugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-4c5b9995-c31f-4d2b-8426-654e16b213bd for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-e0cad777-3072-4b8b-8a45-b4bf12c70f7c req-62b1a7d3-d582-44ec-9dff-196dbc357f35 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-4c5b9995-c31f-4d2b-8426-654e16b213bd for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-unplugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-72a2ff38-f9ff-4207-acee-f4aae1916935 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-72a2ff38-f9ff-4207-acee-f4aae1916935 for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-unplugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-4e410728-06eb-4513-8b9f-2a3c93c8af1e for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-unplugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: WARNING nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-4cc0cf5e-e34a-489e-86bf-0055280695d7 for instance with vm_state active and task_state deleting.
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-unplugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-cd3df653-08ed-47a7-ba9e-9a50d6559fb6 req-95199d41-40f0-4d96-ac73-ee90740a3c6f service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-unplugged-9d25524e-f12f-45cc-9d48-4f38593b6787 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap628847f4-3e, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc2067b4-33, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4d3c10f-3ea0-49f0-be0c-d70a4bacff30) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40d24d62-4bd4-4ad1-84bb-243072bbec11) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: INFO os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:35:64,bridge_name='br-int',has_traffic_filtering=True,id=b3ffb2ec-11af-45de-a8dc-71263904b4ad,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3ffb2ec-11')
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:93:43,bridge_name='br-int',has_traffic_filtering=True,id=4e410728-06eb-4513-8b9f-2a3c93c8af1e,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e410728-06') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:93:43,bridge_name='br-int',has_traffic_filtering=True,id=4e410728-06eb-4513-8b9f-2a3c93c8af1e,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e410728-06') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9de2bd29-4e6c-477c-9467-a60a73786735) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: INFO os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=628847f4-3e6e-4afa-821c-7d9869e65909,network=Network(4fa5e679-abd5-4829-8971-c23eb99232a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628847f4-3e')
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:62:e0,bridge_name='br-int',has_traffic_filtering=True,id=72a2ff38-f9ff-4207-acee-f4aae1916935,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72a2ff38-f9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:62:e0,bridge_name='br-int',has_traffic_filtering=True,id=72a2ff38-f9ff-4207-acee-f4aae1916935,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72a2ff38-f9') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e410728-06, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: INFO os_vif [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:70:83,bridge_name='br-int',has_traffic_filtering=True,id=cc2067b4-33bb-4cf7-9a0f-d7c2537308be,network=Network(cb0c0241-3e37-47a2-96d8-d8eb31c58df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2067b4-33')
Nov 15 11:12:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Deleting instance files /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042_del
Nov 15 11:12:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Deletion of /opt/stack/data/nova/instances/a920e6ce-95d2-445c-b485-548da3d81042_del complete
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: INFO nova.compute.manager [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Took 2.16 seconds to destroy the instance on the hypervisor.
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a920e6ce-95d2-445c-b485-548da3d81042] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a2ff38-f9, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=083f344b-b43e-4acb-880e-d8947c99b25a) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a is timed out.
Nov 15 11:12:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully detached device vdb from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the live domain config.
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnQHNGxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:06 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2000cd21-48bb-443b-bb44-d9cf63271695]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:06 user nova-compute[76049]: No targets found.
Nov 15 11:12:06 user nova-compute[76049]: iSNS:
Nov 15 11:12:06 user nova-compute[76049]: No targets found.
Nov 15 11:12:06 user nova-compute[76049]: STATIC:
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:06 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:06 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:06 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:06 user nova-compute[76049]: No targets found.
Nov 15 11:12:06 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:06 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:06 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=387417f3-16c9-46d7-a08c-5173915690b7) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: INFO os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:93:43,bridge_name='br-int',has_traffic_filtering=True,id=4e410728-06eb-4513-8b9f-2a3c93c8af1e,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e410728-06')
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "address": "fa:16:3e:c3:c8:b8", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2778b2-2e", "ovs_interfaceid": "9e2778b2-2e82-437e-9b8c-64cba0c7165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=9e2778b2-2e82-437e-9b8c-64cba0c7165b,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2778b2-2e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=9e2778b2-2e82-437e-9b8c-64cba0c7165b,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2778b2-2e') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10df492-78f3-4e82-856d-ffa6e6dfc14a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4af33f-532c-4a80-9c87-d728bed3928c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:06 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284266cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77'): ({'sdk'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Removing single pathed devices sdk {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d8a31-8583-4ccc-afa2-1a7456e91f4b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e2778b2-2e, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: INFO os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:62:e0,bridge_name='br-int',has_traffic_filtering=True,id=72a2ff38-f9ff-4207-acee-f4aae1916935,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72a2ff38-f9')
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=54f92c53-94cb-4593-929e-0040324c8400,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54f92c53-94') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=54f92c53-94cb-4593-929e-0040324c8400,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54f92c53-94') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e07349-08ff-4087-9d9f-ba5f7a7383cd]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Flushing IO for device /dev/sdk {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c64f31-a403-4b51-ab0d-94b6ff8b341d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf71b6a5-8de2-4e4f-b694-5bd705af9dd3]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] SCSI volumes sdk have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54f92c53-94, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=411647e5-0a9c-48b7-86df-8d3bb6bb2b1d) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.119s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6824538-0f28-4b49-81e1-eec8f8f4a1fa]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27513c0c-11bf-48a7-ab2c-421f49707aa9) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=9e2778b2-2e82-437e-9b8c-64cba0c7165b,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2778b2-2e')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:13:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cc0cf5e-e34a-489e-86bf-0055280695d7,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0cf5e-e3') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:13:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cc0cf5e-e34a-489e-86bf-0055280695d7,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0cf5e-e3') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.123s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc7734-eea3-4284-9f0c-5a9d25469df8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260]
Nov 15 11:12:07 user nova-compute[76049]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cc0cf5e-e3, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=54f92c53-94cb-4593-929e-0040324c8400,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54f92c53-94')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:88:82,bridge_name='br-int',has_traffic_filtering=True,id=0962aed1-0769-49b5-beff-b100e4efca61,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0962aed1-07') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:88:82,bridge_name='br-int',has_traffic_filtering=True,id=0962aed1-0769-49b5-beff-b100e4efca61,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0962aed1-07') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0034cf7-46b8-4cc1-98d4-cb75c5a34b77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aebfd5-8526-4da8-b89b-c29aaf9076f3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.501s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] <== disconnect_volume: return (502ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0962aed1-07, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53d1fff7-294e-4bf2-9e7d-183be025f073) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b0ede16-bad4-4579-9d92-9f14e3215ccc) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:13:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cc0cf5e-e34a-489e-86bf-0055280695d7,network=Network(3c0b55db-5853-499f-a903-a309fedcfd19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0cf5e-e3')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c3:cc,bridge_name='br-int',has_traffic_filtering=True,id=fec0748e-c7bd-47b4-a5e8-bf4d14ad959b,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec0748e-c7') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c3:cc,bridge_name='br-int',has_traffic_filtering=True,id=fec0748e-c7bd-47b4-a5e8-bf4d14ad959b,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec0748e-c7') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfec0748e-c7, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:88:82,bridge_name='br-int',has_traffic_filtering=True,id=0962aed1-0769-49b5-beff-b100e4efca61,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0962aed1-07')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:0d:7f,bridge_name='br-int',has_traffic_filtering=True,id=81a358fb-5ab5-4f2b-8551-b5db194907ed,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a358fb-5a') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0d:7f,bridge_name='br-int',has_traffic_filtering=True,id=81a358fb-5ab5-4f2b-8551-b5db194907ed,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a358fb-5a') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81a358fb-5a, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Acquiring lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "b002ac80-978b-490c-89ed-2031b850a4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] No waiting events found dispatching network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:07 user nova-compute[76049]: WARNING nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received unexpected event network-vif-plugged-9d25524e-f12f-45cc-9d48-4f38593b6787 for instance with vm_state active and task_state deleting.
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-unplugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-unplugged-043cd6d1-7987-4ea2-921d-28568431277d for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Acquiring lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] No waiting events found dispatching network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:07 user nova-compute[76049]: WARNING nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received unexpected event network-vif-plugged-043cd6d1-7987-4ea2-921d-28568431277d for instance with vm_state active and task_state deleting.
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-vif-unplugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] No waiting events found dispatching network-vif-unplugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-vif-unplugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Acquiring lock "a920e6ce-95d2-445c-b485-548da3d81042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] Lock "a920e6ce-95d2-445c-b485-548da3d81042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] No waiting events found dispatching network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:07 user nova-compute[76049]: WARNING nova.compute.manager [req-0a92a599-bf49-4ea1-9588-f23ff8f9055a req-26c2127b-e46d-412c-8d73-2e2d29d29e2a service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received unexpected event network-vif-plugged-cc2067b4-33bb-4cf7-9a0f-d7c2537308be for instance with vm_state active and task_state deleting.
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05a16c8f-8d4f-40df-838a-cf227a47155a) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dc3c956-6eb9-4c3d-9575-f047306ffdcb) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c3:cc,bridge_name='br-int',has_traffic_filtering=True,id=fec0748e-c7bd-47b4-a5e8-bf4d14ad959b,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec0748e-c7')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1563933811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1563933811',id=10,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq6q1XaKhqwk7PyM1W4XSJWZso3YZjH7VP2+2ZeknAQ839EkfJs9uli63l9mny05+imIRXmD1fpOk4/lrTStvcKQsVqHWiLQtQzRlIXFisl1hP2fopWWjeT3ka920IDA==',key_name='tempest-keypair-465724627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a967062ddbe4838a5d4fefcec26e905',ramdisk_id='',reservation_id='r-um8uh0rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1882503912',owner_user_name='tempest-TaggedBootDevicesTest_v242-1882503912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c143073e9cd4d7c9ac0423a6ce2da5e',uuid=84391b07-a2b0-4053-b6d5-3d9912dcb7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converting VIF {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=043cd6d1-7987-4ea2-921d-28568431277d,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043cd6d1-79') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=043cd6d1-7987-4ea2-921d-28568431277d,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043cd6d1-79') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Took 1.15 seconds to deallocate network for instance.
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap043cd6d1-79, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0d:7f,bridge_name='br-int',has_traffic_filtering=True,id=81a358fb-5ab5-4f2b-8551-b5db194907ed,network=Network(83ad43aa-8938-4c85-9744-d8dc793623d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a358fb-5a')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "9d25524e-f12f-45cc-9d48-4f38593b6787", "address": "fa:16:3e:5c:af:ec", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d25524e-f1", "ovs_interfaceid": "9d25524e-f12f-45cc-9d48-4f38593b6787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:ec,bridge_name='br-int',has_traffic_filtering=True,id=9d25524e-f12f-45cc-9d48-4f38593b6787,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d25524e-f1') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:ec,bridge_name='br-int',has_traffic_filtering=True,id=9d25524e-f12f-45cc-9d48-4f38593b6787,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d25524e-f1') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d25524e-f1, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9551f7b1-ff59-41d1-8044-765ade2a1ea8) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78a07a3c-291a-4f97-bafe-070fcc80d260) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=043cd6d1-7987-4ea2-921d-28568431277d,network=Network(abe465a6-6431-4e84-89cf-c7162c163384),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043cd6d1-79')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YpMtnFEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:ec,bridge_name='br-int',has_traffic_filtering=True,id=9d25524e-f12f-45cc-9d48-4f38593b6787,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d25524e-f1')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1861293053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1861293053',id=11,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUM5l6zgtG9NKEC9Hn/iDIOKm4xiJnOOTUrio+RpAk1rE9gQSgW+VzNyWkxxK75n0X8QC4laeCtbf4fXPd3pl8Rfj6bU4WcKSpM9AeDD6m4ABGUMz5VSZWeDUSu3EPmAA==',key_name='tempest-keypair-965254249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2642a87708964e60a9f4560bdd1ae73a',ramdisk_id='',reservation_id='r-qn304v9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-495262631',owner_user_name='tempest-TaggedBootDevicesTest-495262631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4af6aede6c8461aaf6b2ce2545cffc2',uuid=b002ac80-978b-490c-89ed-2031b850a4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converting VIF {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:26:a7,bridge_name='br-int',has_traffic_filtering=True,id=4c5b9995-c31f-4d2b-8426-654e16b213bd,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5b9995-c3') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:26:a7,bridge_name='br-int',has_traffic_filtering=True,id=4c5b9995-c31f-4d2b-8426-654e16b213bd,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5b9995-c3') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c5b9995-c3, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec365012-3e6a-41a6-ad6e-5b7ec113a9c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:07 user nova-compute[76049]: No targets found.
Nov 15 11:12:07 user nova-compute[76049]: iSNS:
Nov 15 11:12:07 user nova-compute[76049]: No targets found.
Nov 15 11:12:07 user nova-compute[76049]: STATIC:
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:07 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:07 user nova-compute[76049]: No targets found.
Nov 15 11:12:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:07 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:07 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f98580bc-de54-4266-a651-503e6af09774) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:07 user nova-compute[76049]: INFO os_vif [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:26:a7,bridge_name='br-int',has_traffic_filtering=True,id=4c5b9995-c31f-4d2b-8426-654e16b213bd,network=Network(50048e61-625f-4a60-840b-ea877b6f568a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5b9995-c3')
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c89457-0bbe-4cba-8fa6-2a4842e0d298]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwYOMBIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c046876-99c3-40f7-855a-0a528f007c74]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629c124ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f5ef91-00ba-448a-ab78-ba2c418edd49]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c59ba4-0a85-4ceb-8037-3eccb73efed8]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f827ac0b-3dea-4745-9079-07c7637e653c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a4d159-30db-453b-8100-b1016e8885ff]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6dd611-e92d-4ae8-936f-8678edd4406b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d3c2a-baca-404d-b73e-81bdc1300d7c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260]
Nov 15 11:12:07 user nova-compute[76049]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'flavor' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd09170c-4649-4362-88a2-88e036d33816 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9f778-de57-4715-a124-40f80bb09602]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== disconnect_volume: return (373ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.310s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJAQvZHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:08 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Deleted allocations for instance a920e6ce-95d2-445c-b485-548da3d81042
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a2c9d4-f88e-4906-bbf4-696981084e6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]: iSNS:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]: STATIC:
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:08 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:08 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5444f0bf-380d-4606-9943-8f11371a0bfc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7412c07f-c741-470f-b285-c1d4085b6307 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e53d1b-7aaa-4aa2-b05b-6e0f3ba5c691]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284291f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23be84f2-3033-4ba7-ac68-07e696d4ae33 tempest-AttachSCSIVolumeTestJSON-846648667 tempest-AttachSCSIVolumeTestJSON-846648667-project-member] Lock "a920e6ce-95d2-445c-b485-548da3d81042" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.896s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[638af940-bc54-4658-9731-b6f1be0c81ce]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3813db6f-f355-49fc-a4e3-c43e613e5dfa]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e0572-3848-463c-9a20-1c5a45aae37a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[901fbadb-f057-4202-959f-ed2f62cc9821]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b70482-2a28-49b0-be2d-8507fd7a6447]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c571146-aaf5-4bfe-bab3-8f2c1c2d3623]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260]
Nov 15 11:12:08 user nova-compute[76049]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e576fba2-1e9d-446d-8b8a-a2e4426dad78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[925bf370-43ad-453a-a0ec-1045075a3b70]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== disconnect_volume: return (671ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.347s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIyUKlEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[41079e92-47a9-4897-b37e-3d01f119422a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]: iSNS:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]: STATIC:
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:08 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:08 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[de203c29-e978-4c56-8337-e5a6aeb8d14e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7534ee-a7e5-46b0-8161-de24eedd8f27]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842a7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2'): ({'sdg'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Removing single pathed devices sdg {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb4648b-8611-49bd-a9b5-2f294f3bf7fc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1a5683-936b-4e57-843c-a00547042afb]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Flushing IO for device /dev/sdg {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df5377-ba96-4eda-9dff-24292987e984]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b0152-56ac-4ddc-84b3-a9c266945c4c]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a67a6-2953-4378-8807-2c611b79937f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[84856b35-b4b9-45b7-9c5e-ed0433d93be7]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260]
Nov 15 11:12:08 user nova-compute[76049]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6afb24-dfc4-4ce6-9028-663fd8afa3d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3990f586-052e-4510-b9c1-2959de50b2e3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== disconnect_volume: return (690ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.341s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjQlTgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ad70ea-bd5e-4aab-bec0-e6a5e011c230]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]: iSNS:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]: STATIC:
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:08 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:08 user nova-compute[76049]: No targets found.
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:08 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:08 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c65745-a017-424f-81b6-512086b0389a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[255486eb-3e72-4cd8-b17b-b6d4aeff04c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842a7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32'): ({'sdd'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Removing single pathed devices sdd {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c4fb3-bb04-413c-b1d3-bcb4c67ce139]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "interface-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-b186c509-ea79-43d5-99f1-5dd2cf32ff58" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "interface-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-b186c509-ea79-43d5-99f1-5dd2cf32ff58" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dbbc18-82d9-40f1-86e5-9defe259771d]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Flushing IO for device /dev/sdd {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'flavor' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a3f0fa-f9ba-4d27-98c0-6e1c1d9df11d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converting VIF {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface> {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface> {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Attempting to detach device tapb186c509-ea from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] detach device xml: <interface type="ethernet">
Nov 15 11:12:08 user nova-compute[76049]:   <mac address="fa:16:3e:e7:b4:19"/>
Nov 15 11:12:08 user nova-compute[76049]:   <model type="virtio"/>
Nov 15 11:12:08 user nova-compute[76049]:   <mtu size="1442"/>
Nov 15 11:12:08 user nova-compute[76049]:   <target dev="tapb186c509-ea"/>
Nov 15 11:12:08 user nova-compute[76049]: </interface>
Nov 15 11:12:08 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface> {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 11:12:08 user nova-compute[76049]:   <name>instance-00000006</name>
Nov 15 11:12:08 user nova-compute[76049]:   <uuid>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</uuid>
Nov 15 11:12:08 user nova-compute[76049]:   <metadata>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:08 user nova-compute[76049]:   <nova:package version="0.0.0"/>
Nov 15 11:12:08 user nova-compute[76049]:   <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:12:08 user nova-compute[76049]:   <nova:creationTime>2023-11-15 11:11:37</nova:creationTime>
Nov 15 11:12:08 user nova-compute[76049]:   <nova:flavor name="m1.tiny">
Nov 15 11:12:08 user nova-compute[76049]:     <nova:memory>512</nova:memory>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:disk>1</nova:disk>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:swap>0</nova:swap>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:08 user nova-compute[76049]:   </nova:flavor>
Nov 15 11:12:08 user nova-compute[76049]:   <nova:owner>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:12:08 user nova-compute[76049]:   </nova:owner>
Nov 15 11:12:08 user nova-compute[76049]:   <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:08 user nova-compute[76049]:   <nova:ports>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:12:08 user nova-compute[76049]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:12:08 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:08 user nova-compute[76049]:     <nova:port uuid="b186c509-ea79-43d5-99f1-5dd2cf32ff58">
Nov 15 11:12:08 user nova-compute[76049]:       <nova:ip type="fixed" address="10.10.10.234" ipVersion="4"/>
Nov 15 11:12:08 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:08 user nova-compute[76049]:   </nova:ports>
Nov 15 11:12:08 user nova-compute[76049]: </nova:instance>
Nov 15 11:12:08 user nova-compute[76049]:   </metadata>
Nov 15 11:12:08 user nova-compute[76049]:   <memory unit='KiB'>524288</memory>
Nov 15 11:12:08 user nova-compute[76049]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 11:12:08 user nova-compute[76049]:   <vcpu placement='static'>1</vcpu>
Nov 15 11:12:08 user nova-compute[76049]:   <resource>
Nov 15 11:12:08 user nova-compute[76049]:     <partition>/machine</partition>
Nov 15 11:12:08 user nova-compute[76049]:   </resource>
Nov 15 11:12:08 user nova-compute[76049]:   <sysinfo type='smbios'>
Nov 15 11:12:08 user nova-compute[76049]:     <system>
Nov 15 11:12:08 user nova-compute[76049]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 11:12:08 user nova-compute[76049]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 11:12:08 user nova-compute[76049]:       <entry name='version'>0.0.0</entry>
Nov 15 11:12:08 user nova-compute[76049]:       <entry name='serial'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:08 user nova-compute[76049]:       <entry name='uuid'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:08 user nova-compute[76049]:       <entry name='family'>Virtual Machine</entry>
Nov 15 11:12:08 user nova-compute[76049]:     </system>
Nov 15 11:12:08 user nova-compute[76049]:   </sysinfo>
Nov 15 11:12:08 user nova-compute[76049]:   <os>
Nov 15 11:12:08 user nova-compute[76049]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 11:12:08 user nova-compute[76049]:     <boot dev='hd'/>
Nov 15 11:12:08 user nova-compute[76049]:     <smbios mode='sysinfo'/>
Nov 15 11:12:08 user nova-compute[76049]:   </os>
Nov 15 11:12:08 user nova-compute[76049]:   <features>
Nov 15 11:12:08 user nova-compute[76049]:     <acpi/>
Nov 15 11:12:08 user nova-compute[76049]:     <apic/>
Nov 15 11:12:08 user nova-compute[76049]:     <vmcoreinfo state='on'/>
Nov 15 11:12:08 user nova-compute[76049]:   </features>
Nov 15 11:12:08 user nova-compute[76049]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 11:12:08 user nova-compute[76049]:     <model fallback='forbid'>Nehalem</model>
Nov 15 11:12:08 user nova-compute[76049]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 11:12:08 user nova-compute[76049]:     <feature policy='require' name='vme'/>
Nov 15 11:12:08 user nova-compute[76049]:     <feature policy='require' name='x2apic'/>
Nov 15 11:12:08 user nova-compute[76049]:     <feature policy='require' name='hypervisor'/>
Nov 15 11:12:08 user nova-compute[76049]:   </cpu>
Nov 15 11:12:08 user nova-compute[76049]:   <clock offset='utc'>
Nov 15 11:12:08 user nova-compute[76049]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 11:12:08 user nova-compute[76049]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 11:12:08 user nova-compute[76049]:     <timer name='hpet' present='no'/>
Nov 15 11:12:08 user nova-compute[76049]:   </clock>
Nov 15 11:12:08 user nova-compute[76049]:   <on_poweroff>destroy</on_poweroff>
Nov 15 11:12:08 user nova-compute[76049]:   <on_reboot>restart</on_reboot>
Nov 15 11:12:08 user nova-compute[76049]:   <on_crash>destroy</on_crash>
Nov 15 11:12:08 user nova-compute[76049]:   <devices>
Nov 15 11:12:08 user nova-compute[76049]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 11:12:08 user nova-compute[76049]:     <disk type='file' device='disk'>
Nov 15 11:12:08 user nova-compute[76049]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 11:12:08 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk' index='2'/>
Nov 15 11:12:08 user nova-compute[76049]:       <backingStore type='file' index='3'>
Nov 15 11:12:08 user nova-compute[76049]:         <format type='raw'/>
Nov 15 11:12:08 user nova-compute[76049]:         <source file='/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc'/>
Nov 15 11:12:08 user nova-compute[76049]:         <backingStore/>
Nov 15 11:12:08 user nova-compute[76049]:       </backingStore>
Nov 15 11:12:08 user nova-compute[76049]:       <target dev='vda' bus='virtio'/>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='virtio-disk0'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </disk>
Nov 15 11:12:08 user nova-compute[76049]:     <disk type='file' device='cdrom'>
Nov 15 11:12:08 user nova-compute[76049]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 11:12:08 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config' index='1'/>
Nov 15 11:12:08 user nova-compute[76049]:       <backingStore/>
Nov 15 11:12:08 user nova-compute[76049]:       <target dev='hda' bus='ide'/>
Nov 15 11:12:08 user nova-compute[76049]:       <readonly/>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='ide0-0-0'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </disk>
Nov 15 11:12:08 user nova-compute[76049]:     <controller type='usb' index='0' model='none'>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='usb'/>
Nov 15 11:12:08 user nova-compute[76049]:     </controller>
Nov 15 11:12:08 user nova-compute[76049]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='pci.0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </controller>
Nov 15 11:12:08 user nova-compute[76049]:     <controller type='ide' index='0'>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='ide'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 11:12:08 user nova-compute[76049]:     </controller>
Nov 15 11:12:08 user nova-compute[76049]:     <interface type='ethernet'>
Nov 15 11:12:08 user nova-compute[76049]:       <mac address='fa:16:3e:da:28:bc'/>
Nov 15 11:12:08 user nova-compute[76049]:       <target dev='tap3b9f20e6-2c'/>
Nov 15 11:12:08 user nova-compute[76049]:       <model type='virtio'/>
Nov 15 11:12:08 user nova-compute[76049]:       <mtu size='1442'/>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='net0'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </interface>
Nov 15 11:12:08 user nova-compute[76049]:     <interface type='ethernet'>
Nov 15 11:12:08 user nova-compute[76049]:       <mac address='fa:16:3e:e7:b4:19'/>
Nov 15 11:12:08 user nova-compute[76049]:       <target dev='tapb186c509-ea'/>
Nov 15 11:12:08 user nova-compute[76049]:       <model type='virtio'/>
Nov 15 11:12:08 user nova-compute[76049]:       <mtu size='1442'/>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='net1'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </interface>
Nov 15 11:12:08 user nova-compute[76049]:     <serial type='pty'>
Nov 15 11:12:08 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:08 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:08 user nova-compute[76049]:       <target type='isa-serial' port='0'>
Nov 15 11:12:08 user nova-compute[76049]:         <model name='isa-serial'/>
Nov 15 11:12:08 user nova-compute[76049]:       </target>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </serial>
Nov 15 11:12:08 user nova-compute[76049]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 11:12:08 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:08 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:08 user nova-compute[76049]:       <target type='serial' port='0'/>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </console>
Nov 15 11:12:08 user nova-compute[76049]:     <input type='mouse' bus='ps2'>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='input0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </input>
Nov 15 11:12:08 user nova-compute[76049]:     <input type='keyboard' bus='ps2'>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='input1'/>
Nov 15 11:12:08 user nova-compute[76049]:     </input>
Nov 15 11:12:08 user nova-compute[76049]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 11:12:08 user nova-compute[76049]:       <listen type='address' address='0.0.0.0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </graphics>
Nov 15 11:12:08 user nova-compute[76049]:     <audio id='1' type='none'/>
Nov 15 11:12:08 user nova-compute[76049]:     <video>
Nov 15 11:12:08 user nova-compute[76049]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='video0'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </video>
Nov 15 11:12:08 user nova-compute[76049]:     <memballoon model='virtio'>
Nov 15 11:12:08 user nova-compute[76049]:       <stats period='10'/>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='balloon0'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </memballoon>
Nov 15 11:12:08 user nova-compute[76049]:     <rng model='virtio'>
Nov 15 11:12:08 user nova-compute[76049]:       <backend model='random'>/dev/urandom</backend>
Nov 15 11:12:08 user nova-compute[76049]:       <alias name='rng0'/>
Nov 15 11:12:08 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 11:12:08 user nova-compute[76049]:     </rng>
Nov 15 11:12:08 user nova-compute[76049]:   </devices>
Nov 15 11:12:08 user nova-compute[76049]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 11:12:08 user nova-compute[76049]:     <label>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</label>
Nov 15 11:12:08 user nova-compute[76049]:     <imagelabel>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</imagelabel>
Nov 15 11:12:08 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:08 user nova-compute[76049]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 11:12:08 user nova-compute[76049]:     <label>+64055:+108</label>
Nov 15 11:12:08 user nova-compute[76049]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 11:12:08 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:08 user nova-compute[76049]: </domain>
Nov 15 11:12:08 user nova-compute[76049]:  {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 11:12:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully detached device tapb186c509-ea from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the persistent domain config.
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] (1/8): Attempting to detach device tapb186c509-ea with device alias net1 from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] detach device xml: <interface type="ethernet">
Nov 15 11:12:08 user nova-compute[76049]:   <mac address="fa:16:3e:e7:b4:19"/>
Nov 15 11:12:08 user nova-compute[76049]:   <model type="virtio"/>
Nov 15 11:12:08 user nova-compute[76049]:   <mtu size="1442"/>
Nov 15 11:12:08 user nova-compute[76049]:   <target dev="tapb186c509-ea"/>
Nov 15 11:12:08 user nova-compute[76049]: </interface>
Nov 15 11:12:08 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfe4815-87cb-4b49-b42a-f75db5c49c5c]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] SCSI volumes sdd have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[43be64c8-e9ef-46d8-9c1a-0d43291b463b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5cbe25-8de3-49b5-8972-aa6a013f38e1]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260]
Nov 15 11:12:09 user nova-compute[76049]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b6e32-3f20-4112-b907-2a59703fcb32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[590de84e-ff09-46e5-b157-086f5548c303]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== disconnect_volume: return (671ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.326s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgImGxtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:09 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d006e1a7-3398-4c72-b89c-2a0c65d00766]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:09 user nova-compute[76049]: No targets found.
Nov 15 11:12:09 user nova-compute[76049]: iSNS:
Nov 15 11:12:09 user nova-compute[76049]: No targets found.
Nov 15 11:12:09 user nova-compute[76049]: STATIC:
Nov 15 11:12:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722
Nov 15 11:12:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:09 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:09 user nova-compute[76049]: No targets found.
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:09 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:09 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940cef0-7ae8-465c-bbe1-7707346dcbf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a24d84-6d7f-49df-bbc0-005c0b623e0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 (non-flash)
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f626072b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722'): ({'sdh'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Removing single pathed devices sdh {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[80199e91-b6e8-4d6d-aac9-04821d86d4bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3679c7-fc0d-4b26-a9c4-e9d7aa3df2d0]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Flushing IO for device /dev/sdh {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b2f1f-d838-4dc5-802a-99500a9aa3ad]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97dec32-54b4-428d-8be4-3e43c1e77832]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] SCSI volumes sdh have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Start waiting for the detach event from libvirt for device tapb186c509-ea with device alias net1 for instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3463a-be2d-4da0-a473-f392932d2b01]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3454759-69a9-46de-ab50-e3d4bfcb61b1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260]
Nov 15 11:12:09 user nova-compute[76049]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80851a8b-1f60-4d35-8e35-d226f3fef722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d79fa-aee0-4647-89bb-e2caa74ff3c4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] <== disconnect_volume: return (648ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Deleting instance files /opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa_del
Nov 15 11:12:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Deletion of /opt/stack/data/nova/instances/84391b07-a2b0-4053-b6d5-3d9912dcb7aa_del complete
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.323s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7986d3-2bc6-4205-9185-a00199ca59b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:09 user nova-compute[76049]: No targets found.
Nov 15 11:12:09 user nova-compute[76049]: iSNS:
Nov 15 11:12:09 user nova-compute[76049]: No targets found.
Nov 15 11:12:09 user nova-compute[76049]: STATIC:
Nov 15 11:12:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11
Nov 15 11:12:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:09 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:09 user nova-compute[76049]: No targets found.
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:09 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:09 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf56c5-7f36-4dcc-bfaa-bfd794692f13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed24f56-2d99-4f4c-8502-0f8643d5a3ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:09 user nova-compute[76049]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 (non-flash)
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284290e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11'): ({'sdf'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Removing single pathed devices sdf {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: INFO nova.compute.manager [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Took 7.18 seconds to destroy the instance on the hypervisor.
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a494e6e8-e6b7-447b-9ea9-5f8f98c32020]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f5ffb-6c3f-46b5-9772-e0614e1f0610]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Flushing IO for device /dev/sdf {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-60cf5081-e14f-491c-803b-feb8a7a9bc69 req-f8917b57-6de3-498d-a0f6-d75b90557ce0 service nova] [instance: a920e6ce-95d2-445c-b485-548da3d81042] Received event network-vif-deleted-cc2067b4-33bb-4cf7-9a0f-d7c2537308be {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102c62b-19e2-408b-abd5-b42b311c35f5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-38d727c5-98aa-48f9-abd5-28e8b3f78aa9 req-8fb24e06-44fe-4d76-a4c4-9bc98f4ca911 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-unplugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-38d727c5-98aa-48f9-abd5-28e8b3f78aa9 req-8fb24e06-44fe-4d76-a4c4-9bc98f4ca911 service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-38d727c5-98aa-48f9-abd5-28e8b3f78aa9 req-8fb24e06-44fe-4d76-a4c4-9bc98f4ca911 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-38d727c5-98aa-48f9-abd5-28e8b3f78aa9 req-8fb24e06-44fe-4d76-a4c4-9bc98f4ca911 service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-38d727c5-98aa-48f9-abd5-28e8b3f78aa9 req-8fb24e06-44fe-4d76-a4c4-9bc98f4ca911 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-unplugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:09 user nova-compute[76049]: WARNING nova.compute.manager [req-38d727c5-98aa-48f9-abd5-28e8b3f78aa9 req-8fb24e06-44fe-4d76-a4c4-9bc98f4ca911 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received unexpected event network-vif-unplugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 for instance with vm_state active and task_state None.
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.104s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ccfa3-26ec-4eab-a0db-d79349cff5c7]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1e173-f9f0-4dc6-aa38-277bc79d7029]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a8d6d-65e2-4a70-81d2-0c428e5955e2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260]
Nov 15 11:12:09 user nova-compute[76049]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ae238b-36d7-4bff-a905-8c511040ee11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[087c0535-5de4-41da-8ff7-4c8697f98ec0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] <== disconnect_volume: return (700ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Deleting instance files /opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1_del
Nov 15 11:12:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Deletion of /opt/stack/data/nova/instances/b002ac80-978b-490c-89ed-2031b850a4e1_del complete
Nov 15 11:12:09 user nova-compute[76049]: INFO nova.compute.manager [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Took 7.49 seconds to destroy the instance on the hypervisor.
Nov 15 11:12:09 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:12:09 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:11 user nova-compute[76049]: WARNING nova.compute.manager [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received unexpected event network-vif-plugged-b186c509-ea79-43d5-99f1-5dd2cf32ff58 for instance with vm_state active and task_state None.
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-deleted-9d25524e-f12f-45cc-9d48-4f38593b6787 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:11 user nova-compute[76049]: INFO nova.compute.manager [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Neutron deleted interface 9d25524e-f12f-45cc-9d48-4f38593b6787; detaching it from the instance and deleting it from the info cache
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [{"id": "628847f4-3e6e-4afa-821c-7d9869e65909", "address": "fa:16:3e:af:1c:62", "network": {"id": "4fa5e679-abd5-4829-8971-c23eb99232a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2115739697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628847f4-3e", "ovs_interfaceid": "628847f4-3e6e-4afa-821c-7d9869e65909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72a2ff38-f9ff-4207-acee-f4aae1916935", "address": "fa:16:3e:21:62:e0", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2ff38-f9", "ovs_interfaceid": "72a2ff38-f9ff-4207-acee-f4aae1916935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "54f92c53-94cb-4593-929e-0040324c8400", "address": "fa:16:3e:62:3b:0c", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54f92c53-94", "ovs_interfaceid": "54f92c53-94cb-4593-929e-0040324c8400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0962aed1-0769-49b5-beff-b100e4efca61", "address": "fa:16:3e:ba:88:82", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0962aed1-07", "ovs_interfaceid": "0962aed1-0769-49b5-beff-b100e4efca61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "address": "fa:16:3e:00:0d:7f", "network": {"id": "83ad43aa-8938-4c85-9744-d8dc793623d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-815491117", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a358fb-5a", "ovs_interfaceid": "81a358fb-5ab5-4f2b-8551-b5db194907ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "address": "fa:16:3e:60:26:a7", "network": {"id": "50048e61-625f-4a60-840b-ea877b6f568a", "bridge": "br-int", "label": "tempest-device-tagging-net2-453585560", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2642a87708964e60a9f4560bdd1ae73a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5b9995-c3", "ovs_interfaceid": "4c5b9995-c31f-4d2b-8426-654e16b213bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-b51e9f6b-f007-45e7-b5de-d1eb0dadb0a1 req-059cd096-d781-4fa5-911a-e6a86c1ae39e service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Detach interface failed, port_id=9d25524e-f12f-45cc-9d48-4f38593b6787, reason: Instance b002ac80-978b-490c-89ed-2031b850a4e1 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-0157953f-aaa4-4a4b-998d-8e28d252ac7d req-1a7b17ef-52a8-42fa-b41a-830b4b7cfba3 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-deleted-9e2778b2-2e82-437e-9b8c-64cba0c7165b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:11 user nova-compute[76049]: INFO nova.compute.manager [req-0157953f-aaa4-4a4b-998d-8e28d252ac7d req-1a7b17ef-52a8-42fa-b41a-830b4b7cfba3 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Neutron deleted interface 9e2778b2-2e82-437e-9b8c-64cba0c7165b; detaching it from the instance and deleting it from the info cache
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-0157953f-aaa4-4a4b-998d-8e28d252ac7d req-1a7b17ef-52a8-42fa-b41a-830b4b7cfba3 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [{"id": "83e89ce0-ade3-4004-9479-ab4c18968959", "address": "fa:16:3e:6e:a7:0a", "network": {"id": "231c2161-ed69-4f89-b3ad-9247a1ac0f1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366646930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e89ce0-ad", "ovs_interfaceid": "83e89ce0-ade3-4004-9479-ab4c18968959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "address": "fa:16:3e:1e:35:64", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ffb2ec-11", "ovs_interfaceid": "b3ffb2ec-11af-45de-a8dc-71263904b4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "address": "fa:16:3e:0d:93:43", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e410728-06", "ovs_interfaceid": "4e410728-06eb-4513-8b9f-2a3c93c8af1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "address": "fa:16:3e:5e:13:b4", "network": {"id": "3c0b55db-5853-499f-a903-a309fedcfd19", "bridge": "br-int", "label": "tempest-device-tagging-net1-1893344557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0cf5e-e3", "ovs_interfaceid": "4cc0cf5e-e34a-489e-86bf-0055280695d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "address": "fa:16:3e:01:c3:cc", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec0748e-c7", "ovs_interfaceid": "fec0748e-c7bd-47b4-a5e8-bf4d14ad959b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "043cd6d1-7987-4ea2-921d-28568431277d", "address": "fa:16:3e:6a:93:bd", "network": {"id": "abe465a6-6431-4e84-89cf-c7162c163384", "bridge": "br-int", "label": "tempest-device-tagging-net2-1060998020", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a967062ddbe4838a5d4fefcec26e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043cd6d1-79", "ovs_interfaceid": "043cd6d1-7987-4ea2-921d-28568431277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-0157953f-aaa4-4a4b-998d-8e28d252ac7d req-1a7b17ef-52a8-42fa-b41a-830b4b7cfba3 service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Detach interface failed, port_id=9e2778b2-2e82-437e-9b8c-64cba0c7165b, reason: Instance 84391b07-a2b0-4053-b6d5-3d9912dcb7aa could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:12:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:13 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Took 3.78 seconds to deallocate network for instance.
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:13 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Took 3.77 seconds to deallocate network for instance.
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e7b3676-552d-4de0-a23b-faddf9ce2876 req-2ba2ad43-c19f-42c3-8f7b-7f35b2834b39 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-deleted-0962aed1-0769-49b5-beff-b100e4efca61 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e7b3676-552d-4de0-a23b-faddf9ce2876 req-2ba2ad43-c19f-42c3-8f7b-7f35b2834b39 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-deleted-4c5b9995-c31f-4d2b-8426-654e16b213bd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e7b3676-552d-4de0-a23b-faddf9ce2876 req-2ba2ad43-c19f-42c3-8f7b-7f35b2834b39 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-deleted-81a358fb-5ab5-4f2b-8551-b5db194907ed {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e7b3676-552d-4de0-a23b-faddf9ce2876 req-2ba2ad43-c19f-42c3-8f7b-7f35b2834b39 service nova] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Received event network-vif-deleted-628847f4-3e6e-4afa-821c-7d9869e65909 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ce53c6d-a62a-4cb0-bea5-169d6f0e9c7f req-42e0d7a5-41e4-4e65-bac8-1febbf22d02b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-deleted-83e89ce0-ade3-4004-9479-ab4c18968959 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ce53c6d-a62a-4cb0-bea5-169d6f0e9c7f req-42e0d7a5-41e4-4e65-bac8-1febbf22d02b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-deleted-043cd6d1-7987-4ea2-921d-28568431277d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ce53c6d-a62a-4cb0-bea5-169d6f0e9c7f req-42e0d7a5-41e4-4e65-bac8-1febbf22d02b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-deleted-fec0748e-c7bd-47b4-a5e8-bf4d14ad959b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ce53c6d-a62a-4cb0-bea5-169d6f0e9c7f req-42e0d7a5-41e4-4e65-bac8-1febbf22d02b service nova] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Received event network-vif-deleted-4cc0cf5e-e34a-489e-86bf-0055280695d7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:15 user nova-compute[76049]: INFO nova.compute.manager [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] [instance: 84391b07-a2b0-4053-b6d5-3d9912dcb7aa] Took 2.44 seconds to detach 3 volumes for instance.
Nov 15 11:12:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:15 user nova-compute[76049]: INFO nova.compute.manager [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] [instance: b002ac80-978b-490c-89ed-2031b850a4e1] Took 2.28 seconds to detach 3 volumes for instance.
Nov 15 11:12:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:15 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:15 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.095s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:16 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Deleted allocations for instance 84391b07-a2b0-4053-b6d5-3d9912dcb7aa
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-14a8139f-0d9d-4b7e-9516-437645942ed9 tempest-TaggedBootDevicesTest_v242-1882503912 tempest-TaggedBootDevicesTest_v242-1882503912-project-member] Lock "84391b07-a2b0-4053-b6d5-3d9912dcb7aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.896s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:16 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Deleted allocations for instance b002ac80-978b-490c-89ed-2031b850a4e1
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c595a59-20d8-49b2-a35e-01c6201ef85e tempest-TaggedBootDevicesTest-495262631 tempest-TaggedBootDevicesTest-495262631-project-member] Lock "b002ac80-978b-490c-89ed-2031b850a4e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.193s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a944329-f077-4be4-b780-492b9e9d978d is timed out.
Nov 15 11:12:16 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Successfully detached device vdb from instance 8a944329-f077-4be4-b780-492b9e9d978d from the live domain config.
Nov 15 11:12:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRSYtLWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c26028-5782-4936-bd53-7c2904ef6102]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:12:16 user nova-compute[76049]: No targets found.
Nov 15 11:12:16 user nova-compute[76049]: iSNS:
Nov 15 11:12:16 user nova-compute[76049]: No targets found.
Nov 15 11:12:16 user nova-compute[76049]: STATIC:
Nov 15 11:12:16 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:12:16 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:16 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:16 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac
Nov 15 11:12:16 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:12:16 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:12:16 user nova-compute[76049]: FIRMWARE:
Nov 15 11:12:16 user nova-compute[76049]: No targets found.
Nov 15 11:12:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:12:16 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:12:16 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8f2548-407a-4210-bb22-4410ba1d79a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[607a61cb-561b-46bc-87be-39d978add92c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:16 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac (non-flash)
Nov 15 11:12:16 user nova-compute[76049]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842a4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac'): ({'sdj'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Removing single pathed devices sdj {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e260d704-8a3e-44ae-89b3-156ac1fd5e46]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a625accf-fe74-4e3b-9977-312a86538b0e]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Flushing IO for device /dev/sdj {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cefc56-aef5-4808-a2ce-3cafb1c7c66c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aa71bf-2f70-4c27-80a1-4e97282fc164]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] SCSI volumes sdj have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:12:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc30462-9c9d-450f-b054-5eed3116366e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238a73a-736e-499d-9921-5a86e64a703a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260]
Nov 15 11:12:17 user nova-compute[76049]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6531b01-3157-41fe-a422-86545cdbb8ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8c464a-2726-4042-9ca4-e9f7d68312f0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] <== disconnect_volume: return (319ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG nova.objects.instance [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lazy-loading 'flavor' on Instance uuid 8a944329-f077-4be4-b780-492b9e9d978d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-41c45d39-3ba2-408d-954e-ae559921fce5 tempest-VolumesAssistedSnapshotsTest-1356463296 tempest-VolumesAssistedSnapshotsTest-1356463296-project-admin] Lock "8a944329-f077-4be4-b780-492b9e9d978d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:12:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:12:19 user nova-compute[76049]: INFO nova.compute.claims [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Claim successful on node user
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:12:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.policy [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bd63b00a9c4f8983e335cf898f77ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a9fe3c211d4bb78b9c6878147a9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:12:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Creating image(s)
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk 1073741824" returned: 0 in 0.052s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Successfully created port: ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:12:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Cannot resize image /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Ensure instance console log exists: /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Successfully updated port: ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received event network-changed-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Refreshing instance network info cache due to event network-changed-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] Acquiring lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updating instance_info_cache with network_info: [{"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Instance network_info: |[{"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] Acquired lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.neutron [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Refreshing network info cache for port ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Start _get_guest_xml network_info=[{"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:12:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1356958465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1356958465',id=13,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-jreq370v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:12:20Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=d0f0287a-5e2c-4a02-8490-da45ae1e86b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebcf4f7a-9f') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'pci_devices' on Instance uuid d0f0287a-5e2c-4a02-8490-da45ae1e86b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:12:21 user nova-compute[76049]:   <uuid>d0f0287a-5e2c-4a02-8490-da45ae1e86b9</uuid>
Nov 15 11:12:21 user nova-compute[76049]:   <name>instance-0000000d</name>
Nov 15 11:12:21 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:12:21 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:12:21 user nova-compute[76049]:   <metadata>
Nov 15 11:12:21 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:21 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:12:21 user nova-compute[76049]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1356958465</nova:name>
Nov 15 11:12:21 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:12:21</nova:creationTime>
Nov 15 11:12:21 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:12:21 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:12:21 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:12:21 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:12:21 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:21 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:21 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:12:21 user nova-compute[76049]:       <nova:owner>
Nov 15 11:12:21 user nova-compute[76049]:         <nova:user uuid="81bd63b00a9c4f8983e335cf898f77ad">tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member</nova:user>
Nov 15 11:12:21 user nova-compute[76049]:         <nova:project uuid="25a9fe3c211d4bb78b9c6878147a9c75">tempest-ServerBootFromVolumeStableRescueTest-1027868851</nova:project>
Nov 15 11:12:21 user nova-compute[76049]:       </nova:owner>
Nov 15 11:12:21 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:21 user nova-compute[76049]:       <nova:ports>
Nov 15 11:12:21 user nova-compute[76049]:         <nova:port uuid="ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8">
Nov 15 11:12:21 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 11:12:21 user nova-compute[76049]:         </nova:port>
Nov 15 11:12:21 user nova-compute[76049]:       </nova:ports>
Nov 15 11:12:21 user nova-compute[76049]:     </nova:instance>
Nov 15 11:12:21 user nova-compute[76049]:   </metadata>
Nov 15 11:12:21 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:12:21 user nova-compute[76049]:     <system>
Nov 15 11:12:21 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:12:21 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:12:21 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:12:21 user nova-compute[76049]:       <entry name="serial">d0f0287a-5e2c-4a02-8490-da45ae1e86b9</entry>
Nov 15 11:12:21 user nova-compute[76049]:       <entry name="uuid">d0f0287a-5e2c-4a02-8490-da45ae1e86b9</entry>
Nov 15 11:12:21 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:12:21 user nova-compute[76049]:     </system>
Nov 15 11:12:21 user nova-compute[76049]:   </sysinfo>
Nov 15 11:12:21 user nova-compute[76049]:   <os>
Nov 15 11:12:21 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:12:21 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:12:21 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:12:21 user nova-compute[76049]:   </os>
Nov 15 11:12:21 user nova-compute[76049]:   <features>
Nov 15 11:12:21 user nova-compute[76049]:     <acpi/>
Nov 15 11:12:21 user nova-compute[76049]:     <apic/>
Nov 15 11:12:21 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:12:21 user nova-compute[76049]:   </features>
Nov 15 11:12:21 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:12:21 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:12:21 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:12:21 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:12:21 user nova-compute[76049]:   </clock>
Nov 15 11:12:21 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:12:21 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:12:21 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:12:21 user nova-compute[76049]:   </cpu>
Nov 15 11:12:21 user nova-compute[76049]:   <devices>
Nov 15 11:12:21 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:12:21 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:12:21 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk"/>
Nov 15 11:12:21 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:12:21 user nova-compute[76049]:     </disk>
Nov 15 11:12:21 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:12:21 user nova-compute[76049]:       <mac address="fa:16:3e:85:a3:79"/>
Nov 15 11:12:21 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:12:21 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:12:21 user nova-compute[76049]:       <target dev="tapebcf4f7a-9f"/>
Nov 15 11:12:21 user nova-compute[76049]:     </interface>
Nov 15 11:12:21 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:12:21 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/console.log" append="off"/>
Nov 15 11:12:21 user nova-compute[76049]:     </serial>
Nov 15 11:12:21 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:12:21 user nova-compute[76049]:     <video>
Nov 15 11:12:21 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:12:21 user nova-compute[76049]:     </video>
Nov 15 11:12:21 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:12:21 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:12:21 user nova-compute[76049]:     </rng>
Nov 15 11:12:21 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:12:21 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:12:21 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:12:21 user nova-compute[76049]:     </memballoon>
Nov 15 11:12:21 user nova-compute[76049]:   </devices>
Nov 15 11:12:21 user nova-compute[76049]: </domain>
Nov 15 11:12:21 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1356958465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1356958465',id=13,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-jreq370v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:12:20Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=d0f0287a-5e2c-4a02-8490-da45ae1e86b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebcf4f7a-9f') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG os_vif [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebcf4f7a-9f') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff156537-70a0-55e9-b3d3-ca653c63cf38', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebcf4f7a-9f, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebcf4f7a-9f, col_values=(('qos', UUID('c1153f6f-917a-4405-bf3f-eec0ed5a391b')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebcf4f7a-9f, col_values=(('external_ids', {'iface-id': 'ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:a3:79', 'vm-uuid': 'd0f0287a-5e2c-4a02-8490-da45ae1e86b9'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: INFO os_vif [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebcf4f7a-9f')
Nov 15 11:12:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No VIF found with MAC fa:16:3e:85:a3:79, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.neutron [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updated VIF entry in instance network info cache for port ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG nova.network.neutron [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updating instance_info_cache with network_info: [{"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25be49f1-3eb0-4e8d-905c-841fdda50b63 req-07c379cf-a23b-4440-a55e-3dc5dc06e473 service nova] Releasing lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updating instance_info_cache with network_info: [{"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-30cf5ef6-b108-455c-92ec-02481fba7ad2 req-55f104dd-f66b-403e-8c64-122ef0ac9bba service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received event network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-30cf5ef6-b108-455c-92ec-02481fba7ad2 req-55f104dd-f66b-403e-8c64-122ef0ac9bba service nova] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-30cf5ef6-b108-455c-92ec-02481fba7ad2 req-55f104dd-f66b-403e-8c64-122ef0ac9bba service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-30cf5ef6-b108-455c-92ec-02481fba7ad2 req-55f104dd-f66b-403e-8c64-122ef0ac9bba service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-30cf5ef6-b108-455c-92ec-02481fba7ad2 req-55f104dd-f66b-403e-8c64-122ef0ac9bba service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] No waiting events found dispatching network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:23 user nova-compute[76049]: WARNING nova.compute.manager [req-30cf5ef6-b108-455c-92ec-02481fba7ad2 req-55f104dd-f66b-403e-8c64-122ef0ac9bba service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received unexpected event network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 for instance with vm_state building and task_state spawning.
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:12:25 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Instance spawned successfully.
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:25 user nova-compute[76049]: INFO nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:12:25 user nova-compute[76049]: INFO nova.compute.manager [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Took 5.69 seconds to build instance.
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-d3b2-43c8-beac-acfe2eedc485 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.848s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdl (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-8c7d270d-d266-44e9-a614-8691ddf31a66 req-e05ea9e8-9031-4ab5-b47b-eb9b3a5b980a service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received event network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8c7d270d-d266-44e9-a614-8691ddf31a66 req-e05ea9e8-9031-4ab5-b47b-eb9b3a5b980a service nova] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8c7d270d-d266-44e9-a614-8691ddf31a66 req-e05ea9e8-9031-4ab5-b47b-eb9b3a5b980a service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8c7d270d-d266-44e9-a614-8691ddf31a66 req-e05ea9e8-9031-4ab5-b47b-eb9b3a5b980a service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-8c7d270d-d266-44e9-a614-8691ddf31a66 req-e05ea9e8-9031-4ab5-b47b-eb9b3a5b980a service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] No waiting events found dispatching network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:26 user nova-compute[76049]: WARNING nova.compute.manager [req-8c7d270d-d266-44e9-a614-8691ddf31a66 req-e05ea9e8-9031-4ab5-b47b-eb9b3a5b980a service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received unexpected event network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 for instance with vm_state active and task_state None.
Nov 15 11:12:26 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:26 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7991MB free_disk=25.650516510009766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance cc582aae-00f7-4c3d-b551-a70aac92d7ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c14698a2-4375-4eff-b590-da9bd6b705c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8a944329-f077-4be4-b780-492b9e9d978d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 257a8a67-6214-4cee-a280-dff1a1420f5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:29 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Waiting for libvirt event about the detach of device tapb186c509-ea with device alias net1 from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a is timed out.
Nov 15 11:12:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface> {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 11:12:29 user nova-compute[76049]:   <name>instance-00000006</name>
Nov 15 11:12:29 user nova-compute[76049]:   <uuid>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</uuid>
Nov 15 11:12:29 user nova-compute[76049]:   <metadata>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:29 user nova-compute[76049]:   <nova:package version="0.0.0"/>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:creationTime>2023-11-15 11:11:37</nova:creationTime>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:flavor name="m1.tiny">
Nov 15 11:12:29 user nova-compute[76049]:     <nova:memory>512</nova:memory>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:disk>1</nova:disk>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:swap>0</nova:swap>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:29 user nova-compute[76049]:   </nova:flavor>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:owner>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:12:29 user nova-compute[76049]:   </nova:owner>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:ports>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:12:29 user nova-compute[76049]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:12:29 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:port uuid="b186c509-ea79-43d5-99f1-5dd2cf32ff58">
Nov 15 11:12:29 user nova-compute[76049]:       <nova:ip type="fixed" address="10.10.10.234" ipVersion="4"/>
Nov 15 11:12:29 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:29 user nova-compute[76049]:   </nova:ports>
Nov 15 11:12:29 user nova-compute[76049]: </nova:instance>
Nov 15 11:12:29 user nova-compute[76049]:   </metadata>
Nov 15 11:12:29 user nova-compute[76049]:   <memory unit='KiB'>524288</memory>
Nov 15 11:12:29 user nova-compute[76049]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 11:12:29 user nova-compute[76049]:   <vcpu placement='static'>1</vcpu>
Nov 15 11:12:29 user nova-compute[76049]:   <resource>
Nov 15 11:12:29 user nova-compute[76049]:     <partition>/machine</partition>
Nov 15 11:12:29 user nova-compute[76049]:   </resource>
Nov 15 11:12:29 user nova-compute[76049]:   <sysinfo type='smbios'>
Nov 15 11:12:29 user nova-compute[76049]:     <system>
Nov 15 11:12:29 user nova-compute[76049]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 11:12:29 user nova-compute[76049]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 11:12:29 user nova-compute[76049]:       <entry name='version'>0.0.0</entry>
Nov 15 11:12:29 user nova-compute[76049]:       <entry name='serial'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:29 user nova-compute[76049]:       <entry name='uuid'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:29 user nova-compute[76049]:       <entry name='family'>Virtual Machine</entry>
Nov 15 11:12:29 user nova-compute[76049]:     </system>
Nov 15 11:12:29 user nova-compute[76049]:   </sysinfo>
Nov 15 11:12:29 user nova-compute[76049]:   <os>
Nov 15 11:12:29 user nova-compute[76049]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 11:12:29 user nova-compute[76049]:     <boot dev='hd'/>
Nov 15 11:12:29 user nova-compute[76049]:     <smbios mode='sysinfo'/>
Nov 15 11:12:29 user nova-compute[76049]:   </os>
Nov 15 11:12:29 user nova-compute[76049]:   <features>
Nov 15 11:12:29 user nova-compute[76049]:     <acpi/>
Nov 15 11:12:29 user nova-compute[76049]:     <apic/>
Nov 15 11:12:29 user nova-compute[76049]:     <vmcoreinfo state='on'/>
Nov 15 11:12:29 user nova-compute[76049]:   </features>
Nov 15 11:12:29 user nova-compute[76049]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 11:12:29 user nova-compute[76049]:     <model fallback='forbid'>Nehalem</model>
Nov 15 11:12:29 user nova-compute[76049]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 11:12:29 user nova-compute[76049]:     <feature policy='require' name='vme'/>
Nov 15 11:12:29 user nova-compute[76049]:     <feature policy='require' name='x2apic'/>
Nov 15 11:12:29 user nova-compute[76049]:     <feature policy='require' name='hypervisor'/>
Nov 15 11:12:29 user nova-compute[76049]:   </cpu>
Nov 15 11:12:29 user nova-compute[76049]:   <clock offset='utc'>
Nov 15 11:12:29 user nova-compute[76049]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 11:12:29 user nova-compute[76049]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 11:12:29 user nova-compute[76049]:     <timer name='hpet' present='no'/>
Nov 15 11:12:29 user nova-compute[76049]:   </clock>
Nov 15 11:12:29 user nova-compute[76049]:   <on_poweroff>destroy</on_poweroff>
Nov 15 11:12:29 user nova-compute[76049]:   <on_reboot>restart</on_reboot>
Nov 15 11:12:29 user nova-compute[76049]:   <on_crash>destroy</on_crash>
Nov 15 11:12:29 user nova-compute[76049]:   <devices>
Nov 15 11:12:29 user nova-compute[76049]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 11:12:29 user nova-compute[76049]:     <disk type='file' device='disk'>
Nov 15 11:12:29 user nova-compute[76049]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 11:12:29 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk' index='2'/>
Nov 15 11:12:29 user nova-compute[76049]:       <backingStore type='file' index='3'>
Nov 15 11:12:29 user nova-compute[76049]:         <format type='raw'/>
Nov 15 11:12:29 user nova-compute[76049]:         <source file='/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc'/>
Nov 15 11:12:29 user nova-compute[76049]:         <backingStore/>
Nov 15 11:12:29 user nova-compute[76049]:       </backingStore>
Nov 15 11:12:29 user nova-compute[76049]:       <target dev='vda' bus='virtio'/>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='virtio-disk0'/>
Nov 15 11:12:29 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </disk>
Nov 15 11:12:29 user nova-compute[76049]:     <disk type='file' device='cdrom'>
Nov 15 11:12:29 user nova-compute[76049]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 11:12:29 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config' index='1'/>
Nov 15 11:12:29 user nova-compute[76049]:       <backingStore/>
Nov 15 11:12:29 user nova-compute[76049]:       <target dev='hda' bus='ide'/>
Nov 15 11:12:29 user nova-compute[76049]:       <readonly/>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='ide0-0-0'/>
Nov 15 11:12:29 user nova-compute[76049]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </disk>
Nov 15 11:12:29 user nova-compute[76049]:     <controller type='usb' index='0' model='none'>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='usb'/>
Nov 15 11:12:29 user nova-compute[76049]:     </controller>
Nov 15 11:12:29 user nova-compute[76049]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='pci.0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </controller>
Nov 15 11:12:29 user nova-compute[76049]:     <controller type='ide' index='0'>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='ide'/>
Nov 15 11:12:29 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 11:12:29 user nova-compute[76049]:     </controller>
Nov 15 11:12:29 user nova-compute[76049]:     <interface type='ethernet'>
Nov 15 11:12:29 user nova-compute[76049]:       <mac address='fa:16:3e:da:28:bc'/>
Nov 15 11:12:29 user nova-compute[76049]:       <target dev='tap3b9f20e6-2c'/>
Nov 15 11:12:29 user nova-compute[76049]:       <model type='virtio'/>
Nov 15 11:12:29 user nova-compute[76049]:       <mtu size='1442'/>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='net0'/>
Nov 15 11:12:29 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </interface>
Nov 15 11:12:29 user nova-compute[76049]:     <serial type='pty'>
Nov 15 11:12:29 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:29 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:29 user nova-compute[76049]:       <target type='isa-serial' port='0'>
Nov 15 11:12:29 user nova-compute[76049]:         <model name='isa-serial'/>
Nov 15 11:12:29 user nova-compute[76049]:       </target>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </serial>
Nov 15 11:12:29 user nova-compute[76049]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 11:12:29 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:29 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:29 user nova-compute[76049]:       <target type='serial' port='0'/>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </console>
Nov 15 11:12:29 user nova-compute[76049]:     <input type='mouse' bus='ps2'>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='input0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </input>
Nov 15 11:12:29 user nova-compute[76049]:     <input type='keyboard' bus='ps2'>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='input1'/>
Nov 15 11:12:29 user nova-compute[76049]:     </input>
Nov 15 11:12:29 user nova-compute[76049]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 11:12:29 user nova-compute[76049]:       <listen type='address' address='0.0.0.0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </graphics>
Nov 15 11:12:29 user nova-compute[76049]:     <audio id='1' type='none'/>
Nov 15 11:12:29 user nova-compute[76049]:     <video>
Nov 15 11:12:29 user nova-compute[76049]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='video0'/>
Nov 15 11:12:29 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </video>
Nov 15 11:12:29 user nova-compute[76049]:     <memballoon model='virtio'>
Nov 15 11:12:29 user nova-compute[76049]:       <stats period='10'/>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='balloon0'/>
Nov 15 11:12:29 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </memballoon>
Nov 15 11:12:29 user nova-compute[76049]:     <rng model='virtio'>
Nov 15 11:12:29 user nova-compute[76049]:       <backend model='random'>/dev/urandom</backend>
Nov 15 11:12:29 user nova-compute[76049]:       <alias name='rng0'/>
Nov 15 11:12:29 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 11:12:29 user nova-compute[76049]:     </rng>
Nov 15 11:12:29 user nova-compute[76049]:   </devices>
Nov 15 11:12:29 user nova-compute[76049]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 11:12:29 user nova-compute[76049]:     <label>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</label>
Nov 15 11:12:29 user nova-compute[76049]:     <imagelabel>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</imagelabel>
Nov 15 11:12:29 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:29 user nova-compute[76049]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 11:12:29 user nova-compute[76049]:     <label>+64055:+108</label>
Nov 15 11:12:29 user nova-compute[76049]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 11:12:29 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:29 user nova-compute[76049]: </domain>
Nov 15 11:12:29 user nova-compute[76049]:  {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 11:12:29 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully detached device tapb186c509-ea from instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a from the live domain config.
Nov 15 11:12:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converting VIF {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG os_vif [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb186c509-ea, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8df6894-d9be-4444-970d-f2f80d8e3576) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:29 user nova-compute[76049]: INFO os_vif [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea')
Nov 15 11:12:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:29 user nova-compute[76049]:   <nova:package version="0.0.0"/>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:creationTime>2023-11-15 11:12:29</nova:creationTime>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:flavor name="m1.tiny">
Nov 15 11:12:29 user nova-compute[76049]:     <nova:memory>512</nova:memory>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:disk>1</nova:disk>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:swap>0</nova:swap>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:29 user nova-compute[76049]:   </nova:flavor>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:owner>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:12:29 user nova-compute[76049]:   </nova:owner>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:29 user nova-compute[76049]:   <nova:ports>
Nov 15 11:12:29 user nova-compute[76049]:     <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:12:29 user nova-compute[76049]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:12:29 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:29 user nova-compute[76049]:   </nova:ports>
Nov 15 11:12:29 user nova-compute[76049]: </nova:instance>
Nov 15 11:12:29 user nova-compute[76049]:  {{(pid=76049) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-deleted-b186c509-ea79-43d5-99f1-5dd2cf32ff58 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:30 user nova-compute[76049]: INFO nova.compute.manager [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Neutron deleted interface b186c509-ea79-43d5-99f1-5dd2cf32ff58; detaching it from the instance and deleting it from the info cache
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquired lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.objects.instance [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Lazy-loading 'system_metadata' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.objects.instance [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Lazy-loading 'flavor' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.objects.base [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Object Instance<60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a> lazy-loaded attributes: system_metadata,flavor {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Converting VIF {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface> {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 11:12:30 user nova-compute[76049]:   <name>instance-00000006</name>
Nov 15 11:12:30 user nova-compute[76049]:   <uuid>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</uuid>
Nov 15 11:12:30 user nova-compute[76049]:   <metadata>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:30 user nova-compute[76049]:   <nova:package version="0.0.0"/>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:creationTime>2023-11-15 11:12:29</nova:creationTime>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:flavor name="m1.tiny">
Nov 15 11:12:30 user nova-compute[76049]:     <nova:memory>512</nova:memory>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:disk>1</nova:disk>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:swap>0</nova:swap>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:flavor>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:owner>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:owner>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:ports>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:12:30 user nova-compute[76049]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:12:30 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:ports>
Nov 15 11:12:30 user nova-compute[76049]: </nova:instance>
Nov 15 11:12:30 user nova-compute[76049]:   </metadata>
Nov 15 11:12:30 user nova-compute[76049]:   <memory unit='KiB'>524288</memory>
Nov 15 11:12:30 user nova-compute[76049]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 11:12:30 user nova-compute[76049]:   <vcpu placement='static'>1</vcpu>
Nov 15 11:12:30 user nova-compute[76049]:   <resource>
Nov 15 11:12:30 user nova-compute[76049]:     <partition>/machine</partition>
Nov 15 11:12:30 user nova-compute[76049]:   </resource>
Nov 15 11:12:30 user nova-compute[76049]:   <sysinfo type='smbios'>
Nov 15 11:12:30 user nova-compute[76049]:     <system>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='version'>0.0.0</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='serial'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='uuid'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='family'>Virtual Machine</entry>
Nov 15 11:12:30 user nova-compute[76049]:     </system>
Nov 15 11:12:30 user nova-compute[76049]:   </sysinfo>
Nov 15 11:12:30 user nova-compute[76049]:   <os>
Nov 15 11:12:30 user nova-compute[76049]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 11:12:30 user nova-compute[76049]:     <boot dev='hd'/>
Nov 15 11:12:30 user nova-compute[76049]:     <smbios mode='sysinfo'/>
Nov 15 11:12:30 user nova-compute[76049]:   </os>
Nov 15 11:12:30 user nova-compute[76049]:   <features>
Nov 15 11:12:30 user nova-compute[76049]:     <acpi/>
Nov 15 11:12:30 user nova-compute[76049]:     <apic/>
Nov 15 11:12:30 user nova-compute[76049]:     <vmcoreinfo state='on'/>
Nov 15 11:12:30 user nova-compute[76049]:   </features>
Nov 15 11:12:30 user nova-compute[76049]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 11:12:30 user nova-compute[76049]:     <model fallback='forbid'>Nehalem</model>
Nov 15 11:12:30 user nova-compute[76049]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 11:12:30 user nova-compute[76049]:     <feature policy='require' name='vme'/>
Nov 15 11:12:30 user nova-compute[76049]:     <feature policy='require' name='x2apic'/>
Nov 15 11:12:30 user nova-compute[76049]:     <feature policy='require' name='hypervisor'/>
Nov 15 11:12:30 user nova-compute[76049]:   </cpu>
Nov 15 11:12:30 user nova-compute[76049]:   <clock offset='utc'>
Nov 15 11:12:30 user nova-compute[76049]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 11:12:30 user nova-compute[76049]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 11:12:30 user nova-compute[76049]:     <timer name='hpet' present='no'/>
Nov 15 11:12:30 user nova-compute[76049]:   </clock>
Nov 15 11:12:30 user nova-compute[76049]:   <on_poweroff>destroy</on_poweroff>
Nov 15 11:12:30 user nova-compute[76049]:   <on_reboot>restart</on_reboot>
Nov 15 11:12:30 user nova-compute[76049]:   <on_crash>destroy</on_crash>
Nov 15 11:12:30 user nova-compute[76049]:   <devices>
Nov 15 11:12:30 user nova-compute[76049]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 11:12:30 user nova-compute[76049]:     <disk type='file' device='disk'>
Nov 15 11:12:30 user nova-compute[76049]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 11:12:30 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk' index='2'/>
Nov 15 11:12:30 user nova-compute[76049]:       <backingStore type='file' index='3'>
Nov 15 11:12:30 user nova-compute[76049]:         <format type='raw'/>
Nov 15 11:12:30 user nova-compute[76049]:         <source file='/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc'/>
Nov 15 11:12:30 user nova-compute[76049]:         <backingStore/>
Nov 15 11:12:30 user nova-compute[76049]:       </backingStore>
Nov 15 11:12:30 user nova-compute[76049]:       <target dev='vda' bus='virtio'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='virtio-disk0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </disk>
Nov 15 11:12:30 user nova-compute[76049]:     <disk type='file' device='cdrom'>
Nov 15 11:12:30 user nova-compute[76049]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 11:12:30 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config' index='1'/>
Nov 15 11:12:30 user nova-compute[76049]:       <backingStore/>
Nov 15 11:12:30 user nova-compute[76049]:       <target dev='hda' bus='ide'/>
Nov 15 11:12:30 user nova-compute[76049]:       <readonly/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='ide0-0-0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </disk>
Nov 15 11:12:30 user nova-compute[76049]:     <controller type='usb' index='0' model='none'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='usb'/>
Nov 15 11:12:30 user nova-compute[76049]:     </controller>
Nov 15 11:12:30 user nova-compute[76049]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='pci.0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </controller>
Nov 15 11:12:30 user nova-compute[76049]:     <controller type='ide' index='0'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='ide'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 11:12:30 user nova-compute[76049]:     </controller>
Nov 15 11:12:30 user nova-compute[76049]:     <interface type='ethernet'>
Nov 15 11:12:30 user nova-compute[76049]:       <mac address='fa:16:3e:da:28:bc'/>
Nov 15 11:12:30 user nova-compute[76049]:       <target dev='tap3b9f20e6-2c'/>
Nov 15 11:12:30 user nova-compute[76049]:       <model type='virtio'/>
Nov 15 11:12:30 user nova-compute[76049]:       <mtu size='1442'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='net0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </interface>
Nov 15 11:12:30 user nova-compute[76049]:     <serial type='pty'>
Nov 15 11:12:30 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:30 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:30 user nova-compute[76049]:       <target type='isa-serial' port='0'>
Nov 15 11:12:30 user nova-compute[76049]:         <model name='isa-serial'/>
Nov 15 11:12:30 user nova-compute[76049]:       </target>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </serial>
Nov 15 11:12:30 user nova-compute[76049]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 11:12:30 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:30 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:30 user nova-compute[76049]:       <target type='serial' port='0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </console>
Nov 15 11:12:30 user nova-compute[76049]:     <input type='mouse' bus='ps2'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='input0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </input>
Nov 15 11:12:30 user nova-compute[76049]:     <input type='keyboard' bus='ps2'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='input1'/>
Nov 15 11:12:30 user nova-compute[76049]:     </input>
Nov 15 11:12:30 user nova-compute[76049]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 11:12:30 user nova-compute[76049]:       <listen type='address' address='0.0.0.0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </graphics>
Nov 15 11:12:30 user nova-compute[76049]:     <audio id='1' type='none'/>
Nov 15 11:12:30 user nova-compute[76049]:     <video>
Nov 15 11:12:30 user nova-compute[76049]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='video0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </video>
Nov 15 11:12:30 user nova-compute[76049]:     <memballoon model='virtio'>
Nov 15 11:12:30 user nova-compute[76049]:       <stats period='10'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='balloon0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </memballoon>
Nov 15 11:12:30 user nova-compute[76049]:     <rng model='virtio'>
Nov 15 11:12:30 user nova-compute[76049]:       <backend model='random'>/dev/urandom</backend>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='rng0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </rng>
Nov 15 11:12:30 user nova-compute[76049]:   </devices>
Nov 15 11:12:30 user nova-compute[76049]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 11:12:30 user nova-compute[76049]:     <label>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</label>
Nov 15 11:12:30 user nova-compute[76049]:     <imagelabel>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</imagelabel>
Nov 15 11:12:30 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:30 user nova-compute[76049]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 11:12:30 user nova-compute[76049]:     <label>+64055:+108</label>
Nov 15 11:12:30 user nova-compute[76049]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 11:12:30 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:30 user nova-compute[76049]: </domain>
Nov 15 11:12:30 user nova-compute[76049]:  {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface> {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:b4:19"/><model type="virtio"/><mtu size="1442"/><target dev="tapb186c509-ea"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 11:12:30 user nova-compute[76049]:   <name>instance-00000006</name>
Nov 15 11:12:30 user nova-compute[76049]:   <uuid>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</uuid>
Nov 15 11:12:30 user nova-compute[76049]:   <metadata>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:30 user nova-compute[76049]:   <nova:package version="0.0.0"/>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:creationTime>2023-11-15 11:12:29</nova:creationTime>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:flavor name="m1.tiny">
Nov 15 11:12:30 user nova-compute[76049]:     <nova:memory>512</nova:memory>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:disk>1</nova:disk>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:swap>0</nova:swap>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:flavor>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:owner>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:owner>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:ports>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:12:30 user nova-compute[76049]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:12:30 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:ports>
Nov 15 11:12:30 user nova-compute[76049]: </nova:instance>
Nov 15 11:12:30 user nova-compute[76049]:   </metadata>
Nov 15 11:12:30 user nova-compute[76049]:   <memory unit='KiB'>524288</memory>
Nov 15 11:12:30 user nova-compute[76049]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 11:12:30 user nova-compute[76049]:   <vcpu placement='static'>1</vcpu>
Nov 15 11:12:30 user nova-compute[76049]:   <resource>
Nov 15 11:12:30 user nova-compute[76049]:     <partition>/machine</partition>
Nov 15 11:12:30 user nova-compute[76049]:   </resource>
Nov 15 11:12:30 user nova-compute[76049]:   <sysinfo type='smbios'>
Nov 15 11:12:30 user nova-compute[76049]:     <system>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='version'>0.0.0</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='serial'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='uuid'>60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</entry>
Nov 15 11:12:30 user nova-compute[76049]:       <entry name='family'>Virtual Machine</entry>
Nov 15 11:12:30 user nova-compute[76049]:     </system>
Nov 15 11:12:30 user nova-compute[76049]:   </sysinfo>
Nov 15 11:12:30 user nova-compute[76049]:   <os>
Nov 15 11:12:30 user nova-compute[76049]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 11:12:30 user nova-compute[76049]:     <boot dev='hd'/>
Nov 15 11:12:30 user nova-compute[76049]:     <smbios mode='sysinfo'/>
Nov 15 11:12:30 user nova-compute[76049]:   </os>
Nov 15 11:12:30 user nova-compute[76049]:   <features>
Nov 15 11:12:30 user nova-compute[76049]:     <acpi/>
Nov 15 11:12:30 user nova-compute[76049]:     <apic/>
Nov 15 11:12:30 user nova-compute[76049]:     <vmcoreinfo state='on'/>
Nov 15 11:12:30 user nova-compute[76049]:   </features>
Nov 15 11:12:30 user nova-compute[76049]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 11:12:30 user nova-compute[76049]:     <model fallback='forbid'>Nehalem</model>
Nov 15 11:12:30 user nova-compute[76049]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 11:12:30 user nova-compute[76049]:     <feature policy='require' name='vme'/>
Nov 15 11:12:30 user nova-compute[76049]:     <feature policy='require' name='x2apic'/>
Nov 15 11:12:30 user nova-compute[76049]:     <feature policy='require' name='hypervisor'/>
Nov 15 11:12:30 user nova-compute[76049]:   </cpu>
Nov 15 11:12:30 user nova-compute[76049]:   <clock offset='utc'>
Nov 15 11:12:30 user nova-compute[76049]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 11:12:30 user nova-compute[76049]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 11:12:30 user nova-compute[76049]:     <timer name='hpet' present='no'/>
Nov 15 11:12:30 user nova-compute[76049]:   </clock>
Nov 15 11:12:30 user nova-compute[76049]:   <on_poweroff>destroy</on_poweroff>
Nov 15 11:12:30 user nova-compute[76049]:   <on_reboot>restart</on_reboot>
Nov 15 11:12:30 user nova-compute[76049]:   <on_crash>destroy</on_crash>
Nov 15 11:12:30 user nova-compute[76049]:   <devices>
Nov 15 11:12:30 user nova-compute[76049]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 11:12:30 user nova-compute[76049]:     <disk type='file' device='disk'>
Nov 15 11:12:30 user nova-compute[76049]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 11:12:30 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk' index='2'/>
Nov 15 11:12:30 user nova-compute[76049]:       <backingStore type='file' index='3'>
Nov 15 11:12:30 user nova-compute[76049]:         <format type='raw'/>
Nov 15 11:12:30 user nova-compute[76049]:         <source file='/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc'/>
Nov 15 11:12:30 user nova-compute[76049]:         <backingStore/>
Nov 15 11:12:30 user nova-compute[76049]:       </backingStore>
Nov 15 11:12:30 user nova-compute[76049]:       <target dev='vda' bus='virtio'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='virtio-disk0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </disk>
Nov 15 11:12:30 user nova-compute[76049]:     <disk type='file' device='cdrom'>
Nov 15 11:12:30 user nova-compute[76049]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 11:12:30 user nova-compute[76049]:       <source file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/disk.config' index='1'/>
Nov 15 11:12:30 user nova-compute[76049]:       <backingStore/>
Nov 15 11:12:30 user nova-compute[76049]:       <target dev='hda' bus='ide'/>
Nov 15 11:12:30 user nova-compute[76049]:       <readonly/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='ide0-0-0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </disk>
Nov 15 11:12:30 user nova-compute[76049]:     <controller type='usb' index='0' model='none'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='usb'/>
Nov 15 11:12:30 user nova-compute[76049]:     </controller>
Nov 15 11:12:30 user nova-compute[76049]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='pci.0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </controller>
Nov 15 11:12:30 user nova-compute[76049]:     <controller type='ide' index='0'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='ide'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 11:12:30 user nova-compute[76049]:     </controller>
Nov 15 11:12:30 user nova-compute[76049]:     <interface type='ethernet'>
Nov 15 11:12:30 user nova-compute[76049]:       <mac address='fa:16:3e:da:28:bc'/>
Nov 15 11:12:30 user nova-compute[76049]:       <target dev='tap3b9f20e6-2c'/>
Nov 15 11:12:30 user nova-compute[76049]:       <model type='virtio'/>
Nov 15 11:12:30 user nova-compute[76049]:       <mtu size='1442'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='net0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </interface>
Nov 15 11:12:30 user nova-compute[76049]:     <serial type='pty'>
Nov 15 11:12:30 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:30 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:30 user nova-compute[76049]:       <target type='isa-serial' port='0'>
Nov 15 11:12:30 user nova-compute[76049]:         <model name='isa-serial'/>
Nov 15 11:12:30 user nova-compute[76049]:       </target>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </serial>
Nov 15 11:12:30 user nova-compute[76049]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 11:12:30 user nova-compute[76049]:       <source path='/dev/pts/4'/>
Nov 15 11:12:30 user nova-compute[76049]:       <log file='/opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a/console.log' append='off'/>
Nov 15 11:12:30 user nova-compute[76049]:       <target type='serial' port='0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='serial0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </console>
Nov 15 11:12:30 user nova-compute[76049]:     <input type='mouse' bus='ps2'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='input0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </input>
Nov 15 11:12:30 user nova-compute[76049]:     <input type='keyboard' bus='ps2'>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='input1'/>
Nov 15 11:12:30 user nova-compute[76049]:     </input>
Nov 15 11:12:30 user nova-compute[76049]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 11:12:30 user nova-compute[76049]:       <listen type='address' address='0.0.0.0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </graphics>
Nov 15 11:12:30 user nova-compute[76049]:     <audio id='1' type='none'/>
Nov 15 11:12:30 user nova-compute[76049]:     <video>
Nov 15 11:12:30 user nova-compute[76049]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='video0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </video>
Nov 15 11:12:30 user nova-compute[76049]:     <memballoon model='virtio'>
Nov 15 11:12:30 user nova-compute[76049]:       <stats period='10'/>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='balloon0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </memballoon>
Nov 15 11:12:30 user nova-compute[76049]:     <rng model='virtio'>
Nov 15 11:12:30 user nova-compute[76049]:       <backend model='random'>/dev/urandom</backend>
Nov 15 11:12:30 user nova-compute[76049]:       <alias name='rng0'/>
Nov 15 11:12:30 user nova-compute[76049]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 11:12:30 user nova-compute[76049]:     </rng>
Nov 15 11:12:30 user nova-compute[76049]:   </devices>
Nov 15 11:12:30 user nova-compute[76049]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 11:12:30 user nova-compute[76049]:     <label>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</label>
Nov 15 11:12:30 user nova-compute[76049]:     <imagelabel>libvirt-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a</imagelabel>
Nov 15 11:12:30 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:30 user nova-compute[76049]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 11:12:30 user nova-compute[76049]:     <label>+64055:+108</label>
Nov 15 11:12:30 user nova-compute[76049]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 11:12:30 user nova-compute[76049]:   </seclabel>
Nov 15 11:12:30 user nova-compute[76049]: </domain>
Nov 15 11:12:30 user nova-compute[76049]:  {{(pid=76049) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 11:12:30 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Detaching interface fa:16:3e:e7:b4:19 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb186c509-ea' not found.
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Converting VIF {"id": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "address": "fa:16:3e:e7:b4:19", "network": {"id": "39e0a337-764d-4bc9-b18b-430f0f52bb6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1589345868", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb186c509-ea", "ovs_interfaceid": "b186c509-ea79-43d5-99f1-5dd2cf32ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG os_vif [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb186c509-ea, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:12:30 user nova-compute[76049]: INFO os_vif [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b4:19,bridge_name='br-int',has_traffic_filtering=True,id=b186c509-ea79-43d5-99f1-5dd2cf32ff58,network=Network(39e0a337-764d-4bc9-b18b-430f0f52bb6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb186c509-ea')
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [req-916104d5-dafb-4906-ab04-ec0156a9d576 req-6d07f814-1c45-4977-9d23-04ffb501edbf service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:30 user nova-compute[76049]:   <nova:package version="0.0.0"/>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:name>tempest-device-tagging-server-2102972007</nova:name>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:creationTime>2023-11-15 11:12:30</nova:creationTime>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:flavor name="m1.tiny">
Nov 15 11:12:30 user nova-compute[76049]:     <nova:memory>512</nova:memory>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:disk>1</nova:disk>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:swap>0</nova:swap>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:flavor>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:owner>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:user uuid="ee64d748ff8940748cbddf050539088c">tempest-TaggedAttachmentsTest-995763535-project-member</nova:user>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:project uuid="01388fdbea2f40b38a8c4dd5f8c922c9">tempest-TaggedAttachmentsTest-995763535</nova:project>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:owner>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:30 user nova-compute[76049]:   <nova:ports>
Nov 15 11:12:30 user nova-compute[76049]:     <nova:port uuid="3b9f20e6-2c85-4c46-bf59-4919ee8731ab">
Nov 15 11:12:30 user nova-compute[76049]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 11:12:30 user nova-compute[76049]:     </nova:port>
Nov 15 11:12:30 user nova-compute[76049]:   </nova:ports>
Nov 15 11:12:30 user nova-compute[76049]: </nova:instance>
Nov 15 11:12:30 user nova-compute[76049]:  {{(pid=76049) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [{"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Releasing lock "refresh_cache-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5098d6ba-3349-4fe9-ac3b-5664a67b36ac tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "interface-60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-b186c509-ea79-43d5-99f1-5dd2cf32ff58" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.743s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "e5b4194d-37cb-47f2-96a1-efe798985010" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "e5b4194d-37cb-47f2-96a1-efe798985010" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:30 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:12:31 user nova-compute[76049]: INFO nova.compute.claims [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Claim successful on node user
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:12:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.policy [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '543673d5b4f241df830806894717043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b6dce9c3847f1be9a07015b683421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:12:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Creating image(s)
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "/opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "/opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Successfully created port: a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.192s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk 1073741824" returned: 0 in 0.046s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Cannot resize image /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Ensure instance console log exists: /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Successfully updated port: a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "refresh_cache-e5b4194d-37cb-47f2-96a1-efe798985010" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquired lock "refresh_cache-e5b4194d-37cb-47f2-96a1-efe798985010" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received event network-changed-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Refreshing instance network info cache due to event network-changed-a17053b8-25d4-4d35-acee-69ecaae13440. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] Acquiring lock "refresh_cache-e5b4194d-37cb-47f2-96a1-efe798985010" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Updating instance_info_cache with network_info: [{"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Releasing lock "refresh_cache-e5b4194d-37cb-47f2-96a1-efe798985010" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Instance network_info: |[{"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] Acquired lock "refresh_cache-e5b4194d-37cb-47f2-96a1-efe798985010" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.neutron [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Refreshing network info cache for port a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Start _get_guest_xml network_info=[{"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:12:32 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:32 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1215641488',display_name='tempest-VolumesAdminNegativeTest-server-1215641488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1215641488',id=14,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1b6dce9c3847f1be9a07015b683421',ramdisk_id='',reservation_id='r-rx8tymbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-448739573',owner_user_name='tempest-VolumesAdminNegativeTest-448739573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:12:32Z,user_data=None,user_id='543673d5b4f241df830806894717043f',uuid=e5b4194d-37cb-47f2-96a1-efe798985010,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converting VIF {"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:6a:d6,bridge_name='br-int',has_traffic_filtering=True,id=a17053b8-25d4-4d35-acee-69ecaae13440,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17053b8-25') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.objects.instance [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lazy-loading 'pci_devices' on Instance uuid e5b4194d-37cb-47f2-96a1-efe798985010 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:12:32 user nova-compute[76049]:   <uuid>e5b4194d-37cb-47f2-96a1-efe798985010</uuid>
Nov 15 11:12:32 user nova-compute[76049]:   <name>instance-0000000e</name>
Nov 15 11:12:32 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:12:32 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:12:32 user nova-compute[76049]:   <metadata>
Nov 15 11:12:32 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:32 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:12:32 user nova-compute[76049]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1215641488</nova:name>
Nov 15 11:12:32 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:12:32</nova:creationTime>
Nov 15 11:12:32 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:12:32 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:12:32 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:12:32 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:12:32 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:32 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:32 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:12:32 user nova-compute[76049]:       <nova:owner>
Nov 15 11:12:32 user nova-compute[76049]:         <nova:user uuid="543673d5b4f241df830806894717043f">tempest-VolumesAdminNegativeTest-448739573-project-member</nova:user>
Nov 15 11:12:32 user nova-compute[76049]:         <nova:project uuid="0b1b6dce9c3847f1be9a07015b683421">tempest-VolumesAdminNegativeTest-448739573</nova:project>
Nov 15 11:12:32 user nova-compute[76049]:       </nova:owner>
Nov 15 11:12:32 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:32 user nova-compute[76049]:       <nova:ports>
Nov 15 11:12:32 user nova-compute[76049]:         <nova:port uuid="a17053b8-25d4-4d35-acee-69ecaae13440">
Nov 15 11:12:32 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 11:12:32 user nova-compute[76049]:         </nova:port>
Nov 15 11:12:32 user nova-compute[76049]:       </nova:ports>
Nov 15 11:12:32 user nova-compute[76049]:     </nova:instance>
Nov 15 11:12:32 user nova-compute[76049]:   </metadata>
Nov 15 11:12:32 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:12:32 user nova-compute[76049]:     <system>
Nov 15 11:12:32 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:12:32 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:12:32 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:12:32 user nova-compute[76049]:       <entry name="serial">e5b4194d-37cb-47f2-96a1-efe798985010</entry>
Nov 15 11:12:32 user nova-compute[76049]:       <entry name="uuid">e5b4194d-37cb-47f2-96a1-efe798985010</entry>
Nov 15 11:12:32 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:12:32 user nova-compute[76049]:     </system>
Nov 15 11:12:32 user nova-compute[76049]:   </sysinfo>
Nov 15 11:12:32 user nova-compute[76049]:   <os>
Nov 15 11:12:32 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:12:32 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:12:32 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:12:32 user nova-compute[76049]:   </os>
Nov 15 11:12:32 user nova-compute[76049]:   <features>
Nov 15 11:12:32 user nova-compute[76049]:     <acpi/>
Nov 15 11:12:32 user nova-compute[76049]:     <apic/>
Nov 15 11:12:32 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:12:32 user nova-compute[76049]:   </features>
Nov 15 11:12:32 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:12:32 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:12:32 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:12:32 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:12:32 user nova-compute[76049]:   </clock>
Nov 15 11:12:32 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:12:32 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:12:32 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:12:32 user nova-compute[76049]:   </cpu>
Nov 15 11:12:32 user nova-compute[76049]:   <devices>
Nov 15 11:12:32 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:12:32 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:12:32 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk"/>
Nov 15 11:12:32 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:12:32 user nova-compute[76049]:     </disk>
Nov 15 11:12:32 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:12:32 user nova-compute[76049]:       <mac address="fa:16:3e:59:6a:d6"/>
Nov 15 11:12:32 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:12:32 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:12:32 user nova-compute[76049]:       <target dev="tapa17053b8-25"/>
Nov 15 11:12:32 user nova-compute[76049]:     </interface>
Nov 15 11:12:32 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:12:32 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/console.log" append="off"/>
Nov 15 11:12:32 user nova-compute[76049]:     </serial>
Nov 15 11:12:32 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:12:32 user nova-compute[76049]:     <video>
Nov 15 11:12:32 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:12:32 user nova-compute[76049]:     </video>
Nov 15 11:12:32 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:12:32 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:12:32 user nova-compute[76049]:     </rng>
Nov 15 11:12:32 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:12:32 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:12:32 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:12:32 user nova-compute[76049]:     </memballoon>
Nov 15 11:12:32 user nova-compute[76049]:   </devices>
Nov 15 11:12:32 user nova-compute[76049]: </domain>
Nov 15 11:12:32 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1215641488',display_name='tempest-VolumesAdminNegativeTest-server-1215641488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1215641488',id=14,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b1b6dce9c3847f1be9a07015b683421',ramdisk_id='',reservation_id='r-rx8tymbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-448739573',owner_user_name='tempest-VolumesAdminNegativeTest-448739573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:12:32Z,user_data=None,user_id='543673d5b4f241df830806894717043f',uuid=e5b4194d-37cb-47f2-96a1-efe798985010,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converting VIF {"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:6a:d6,bridge_name='br-int',has_traffic_filtering=True,id=a17053b8-25d4-4d35-acee-69ecaae13440,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17053b8-25') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG os_vif [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6a:d6,bridge_name='br-int',has_traffic_filtering=True,id=a17053b8-25d4-4d35-acee-69ecaae13440,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17053b8-25') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad08835e-9ebc-5d05-a27e-39c417558e28', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa17053b8-25, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa17053b8-25, col_values=(('qos', UUID('79c45dd4-dbb0-4145-bbde-23644aa59aab')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa17053b8-25, col_values=(('external_ids', {'iface-id': 'a17053b8-25d4-4d35-acee-69ecaae13440', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:6a:d6', 'vm-uuid': 'e5b4194d-37cb-47f2-96a1-efe798985010'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:32 user nova-compute[76049]: INFO os_vif [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6a:d6,bridge_name='br-int',has_traffic_filtering=True,id=a17053b8-25d4-4d35-acee-69ecaae13440,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17053b8-25')
Nov 15 11:12:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:12:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] No VIF found with MAC fa:16:3e:59:6a:d6, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:12:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Updated VIF entry in instance network info cache for port a17053b8-25d4-4d35-acee-69ecaae13440. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:12:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Updating instance_info_cache with network_info: [{"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e1277354-527b-49f2-8655-b6ef29d69224 req-0b78efa8-6e56-41b7-b751-69b761f38642 service nova] Releasing lock "refresh_cache-e5b4194d-37cb-47f2-96a1-efe798985010" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-de690411-8b52-4ea6-82b3-8e0ae8e1f6ca req-73ae9e05-eaae-4740-8ade-7bd9b3a22252 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received event network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-de690411-8b52-4ea6-82b3-8e0ae8e1f6ca req-73ae9e05-eaae-4740-8ade-7bd9b3a22252 service nova] Acquiring lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-de690411-8b52-4ea6-82b3-8e0ae8e1f6ca req-73ae9e05-eaae-4740-8ade-7bd9b3a22252 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-de690411-8b52-4ea6-82b3-8e0ae8e1f6ca req-73ae9e05-eaae-4740-8ade-7bd9b3a22252 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-de690411-8b52-4ea6-82b3-8e0ae8e1f6ca req-73ae9e05-eaae-4740-8ade-7bd9b3a22252 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] No waiting events found dispatching network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:34 user nova-compute[76049]: WARNING nova.compute.manager [req-de690411-8b52-4ea6-82b3-8e0ae8e1f6ca req-73ae9e05-eaae-4740-8ade-7bd9b3a22252 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received unexpected event network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 for instance with vm_state building and task_state spawning.
Nov 15 11:12:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-7972ec7c-343c-42fb-a2dd-e93a9bd0fc6c req-534fc3c9-062b-43b3-8b82-da388db61302 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received event network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7972ec7c-343c-42fb-a2dd-e93a9bd0fc6c req-534fc3c9-062b-43b3-8b82-da388db61302 service nova] Acquiring lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7972ec7c-343c-42fb-a2dd-e93a9bd0fc6c req-534fc3c9-062b-43b3-8b82-da388db61302 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7972ec7c-343c-42fb-a2dd-e93a9bd0fc6c req-534fc3c9-062b-43b3-8b82-da388db61302 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-7972ec7c-343c-42fb-a2dd-e93a9bd0fc6c req-534fc3c9-062b-43b3-8b82-da388db61302 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] No waiting events found dispatching network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:36 user nova-compute[76049]: WARNING nova.compute.manager [req-7972ec7c-343c-42fb-a2dd-e93a9bd0fc6c req-534fc3c9-062b-43b3-8b82-da388db61302 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received unexpected event network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 for instance with vm_state building and task_state spawning.
Nov 15 11:12:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:12:36 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Instance spawned successfully.
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:36 user nova-compute[76049]: INFO nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 15 11:12:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:12:37 user nova-compute[76049]: INFO nova.compute.manager [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Took 5.96 seconds to build instance.
Nov 15 11:12:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-24374097-9caf-455f-82b5-e793f9e346ef tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "e5b4194d-37cb-47f2-96a1-efe798985010" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.066s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Received event network-changed-a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Refreshing instance network info cache due to event network-changed-a7f86da6-569a-42f5-9489-5ac29a0eee39. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] Acquiring lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] Acquired lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Refreshing network info cache for port a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'flavor' on Instance uuid 257a8a67-6214-4cee-a280-dff1a1420f5f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:43 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Ignoring supplied device name: /dev/vdb
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:43 user nova-compute[76049]: INFO nova.compute.manager [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Attaching volume f3be9b12-bb41-49f6-9488-494645bd23c4 to /dev/vdb
Nov 15 11:12:43 user nova-compute[76049]: DEBUG os_brick.utils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd343240-8475-4ef8-abe8-8420ee2d4928]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee80482-d0aa-45e8-b317-fbd27f03d758]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1305f6-daf6-4a2a-9ff4-1f1c65b83cf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a43a26-9181-4b80-a1b8-02ea7f18a2b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Updated VIF entry in instance network info cache for port a7f86da6-569a-42f5-9489-5ac29a0eee39. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Updating instance_info_cache with network_info: [{"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e10cb6d6-df51-4993-ac49-e365c1f8b1d1 req-02f060a4-a3c7-4c0e-8a25-d8cde28be559 service nova] Releasing lock "refresh_cache-257a8a67-6214-4cee-a280-dff1a1420f5f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:12:43 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:12:43 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3286c9d5-fe89-453c-b0e0-600e9e7adbd7]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG os_brick.utils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:43 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Updating existing volume attachment record: 9d462c17-caaf-48fb-9741-beaa7d9aae4f {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:12:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLUJrpqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:12:48 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:48 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:12:48 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e468f27-a818-4909-be22-c6e82cba0971]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:12:48 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e92c4d-c499-4d50-9a3d-09377b7ba8d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4] added
Nov 15 11:12:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a19e840-f0cb-4772-89f9-7db043b35410]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec2dec-eaf5-4583-8aff-b2da97af2947]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLUJrpqt {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLUJrpqt" returned: 0 in 0.042s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dcf79e-ff8d-4ac9-ae3b-9824ce29b494]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RLUJrpqt'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3663ebf5-cf58-45da-8c51-dfd75248eb56]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a8409c-327e-4bd1-baf7-447f643af2d2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97134c5-86d1-4747-ac69-90e6882cf064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260]
Nov 15 11:12:48 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260] successful.
Nov 15 11:12:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8ee0b7-6c2e-4a0a-86dc-b142670d21c0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:12:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "8a944329-f077-4be4-b780-492b9e9d978d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:49 user nova-compute[76049]: INFO nova.compute.manager [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Terminating instance
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca51f37-a78d-43d5-bd68-eafd74a4514d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:49 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:12:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:12:49 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:12:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[044ab8a5-fe2f-4a2a-ba0a-3623ac1412bc]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLUJrpqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-2ee2a92c-8872-4d28-97dc-96d4d0904da9 req-0209fc4e-0dc2-4de8-9a58-32c2de542303 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-vif-unplugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2ee2a92c-8872-4d28-97dc-96d4d0904da9 req-0209fc4e-0dc2-4de8-9a58-32c2de542303 service nova] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2ee2a92c-8872-4d28-97dc-96d4d0904da9 req-0209fc4e-0dc2-4de8-9a58-32c2de542303 service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2ee2a92c-8872-4d28-97dc-96d4d0904da9 req-0209fc4e-0dc2-4de8-9a58-32c2de542303 service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-2ee2a92c-8872-4d28-97dc-96d4d0904da9 req-0209fc4e-0dc2-4de8-9a58-32c2de542303 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] No waiting events found dispatching network-vif-unplugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-2ee2a92c-8872-4d28-97dc-96d4d0904da9 req-0209fc4e-0dc2-4de8-9a58-32c2de542303 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-vif-unplugged-04aa0913-1b50-4e1e-a854-8a97253bee1d for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:12:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Instance destroyed successfully.
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lazy-loading 'resources' on Instance uuid 8a944329-f077-4be4-b780-492b9e9d978d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-612735450',display_name='tempest-VolumesAssistedSnapshotsTest-server-612735450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-612735450',id=8,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNjIKNDoBux+fiIwoPFL5Fv1XrdpdJrgP25ZTbKSes2GXzF/ONIumqULnYgf83UgUmlXOXJONikTLEjzV1vby2ytNEuf4FfYIEMMBX3QJxuBCPUxyowimZMfg2QxhVsPg==',key_name='tempest-keypair-389877131',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ceebd69126949f8a0522015570e74d4',ramdisk_id='',reservation_id='r-cw67v1b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-930918090',owner_user_name='tempest-VolumesAssistedSnapshotsTest-930918090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='191cae5f6c3d46209098196bdbdc429a',uuid=8a944329-f077-4be4-b780-492b9e9d978d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Converting VIF {"id": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "address": "fa:16:3e:c4:1f:9b", "network": {"id": "39d95316-719d-4a54-8e4e-462748371b75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-575436594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ceebd69126949f8a0522015570e74d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04aa0913-1b", "ovs_interfaceid": "04aa0913-1b50-4e1e-a854-8a97253bee1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:1f:9b,bridge_name='br-int',has_traffic_filtering=True,id=04aa0913-1b50-4e1e-a854-8a97253bee1d,network=Network(39d95316-719d-4a54-8e4e-462748371b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04aa0913-1b') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG os_vif [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:1f:9b,bridge_name='br-int',has_traffic_filtering=True,id=04aa0913-1b50-4e1e-a854-8a97253bee1d,network=Network(39d95316-719d-4a54-8e4e-462748371b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04aa0913-1b') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04aa0913-1b, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9caedda6-d3c4-448d-893b-34e0c6ccec57) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:49 user nova-compute[76049]: INFO os_vif [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:1f:9b,bridge_name='br-int',has_traffic_filtering=True,id=04aa0913-1b50-4e1e-a854-8a97253bee1d,network=Network(39d95316-719d-4a54-8e4e-462748371b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04aa0913-1b')
Nov 15 11:12:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Deleting instance files /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d_del
Nov 15 11:12:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Deletion of /opt/stack/data/nova/instances/8a944329-f077-4be4-b780-492b9e9d978d_del complete
Nov 15 11:12:49 user nova-compute[76049]: INFO nova.compute.manager [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 11:12:49 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:12:49 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:12:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:12:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26638323237623530', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:12:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638323237623530', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:12:50 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'flavor' on Instance uuid 257a8a67-6214-4cee-a280-dff1a1420f5f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:12:50 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:12:50 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:12:50 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:12:50 user nova-compute[76049]:   <serial>f3be9b12-bb41-49f6-9488-494645bd23c4</serial>
Nov 15 11:12:50 user nova-compute[76049]: </disk>
Nov 15 11:12:50 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No VIF found with MAC fa:16:3e:21:11:ad, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:51 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Took 1.14 seconds to deallocate network for instance.
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "2e94785d-54bf-499f-a06c-9b96ff7717bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3d49e589-dfcc-4241-b935-96536b5a10fc tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.607s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-bdbe8d9f-dc80-4051-bf96-fec2e70e66c9 req-3f71323d-d9dd-4888-83ff-009e42b8f669 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bdbe8d9f-dc80-4051-bf96-fec2e70e66c9 req-3f71323d-d9dd-4888-83ff-009e42b8f669 service nova] Acquiring lock "8a944329-f077-4be4-b780-492b9e9d978d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bdbe8d9f-dc80-4051-bf96-fec2e70e66c9 req-3f71323d-d9dd-4888-83ff-009e42b8f669 service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bdbe8d9f-dc80-4051-bf96-fec2e70e66c9 req-3f71323d-d9dd-4888-83ff-009e42b8f669 service nova] Lock "8a944329-f077-4be4-b780-492b9e9d978d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-bdbe8d9f-dc80-4051-bf96-fec2e70e66c9 req-3f71323d-d9dd-4888-83ff-009e42b8f669 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] No waiting events found dispatching network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:51 user nova-compute[76049]: WARNING nova.compute.manager [req-bdbe8d9f-dc80-4051-bf96-fec2e70e66c9 req-3f71323d-d9dd-4888-83ff-009e42b8f669 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received unexpected event network-vif-plugged-04aa0913-1b50-4e1e-a854-8a97253bee1d for instance with vm_state deleted and task_state None.
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-bdbe8d9f-dc80-4051-bf96-fec2e70e66c9 req-3f71323d-d9dd-4888-83ff-009e42b8f669 service nova] [instance: 8a944329-f077-4be4-b780-492b9e9d978d] Received event network-vif-deleted-04aa0913-1b50-4e1e-a854-8a97253bee1d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.134s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:12:51 user nova-compute[76049]: INFO nova.compute.claims [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Claim successful on node user
Nov 15 11:12:51 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Deleted allocations for instance 8a944329-f077-4be4-b780-492b9e9d978d
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0c4bc1e3-a7be-4b98-bca5-527d950db36c tempest-VolumesAssistedSnapshotsTest-930918090 tempest-VolumesAssistedSnapshotsTest-930918090-project-member] Lock "8a944329-f077-4be4-b780-492b9e9d978d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:12:52 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.policy [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39adb4a06ee64e4ab6206842b79f5e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e58ca5ef511414d9faadad3a3ad8279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:12:52 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Creating image(s)
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "/opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "/opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Successfully created port: 97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk 1073741824" returned: 0 in 0.094s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:12:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Cannot resize image /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Ensure instance console log exists: /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Successfully updated port: 97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "refresh_cache-2e94785d-54bf-499f-a06c-9b96ff7717bc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquired lock "refresh_cache-2e94785d-54bf-499f-a06c-9b96ff7717bc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.compute.manager [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received event network-changed-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.compute.manager [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Refreshing instance network info cache due to event network-changed-97ed6c86-f21e-466d-8b6a-393ddec792b6. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] Acquiring lock "refresh_cache-2e94785d-54bf-499f-a06c-9b96ff7717bc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Updating instance_info_cache with network_info: [{"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Releasing lock "refresh_cache-2e94785d-54bf-499f-a06c-9b96ff7717bc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Instance network_info: |[{"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] Acquired lock "refresh_cache-2e94785d-54bf-499f-a06c-9b96ff7717bc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.network.neutron [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Refreshing network info cache for port 97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Start _get_guest_xml network_info=[{"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:12:53 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:53 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:12:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-909721055',display_name='tempest-VolumesActionsTest-instance-909721055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-909721055',id=15,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e58ca5ef511414d9faadad3a3ad8279',ramdisk_id='',reservation_id='r-s15fj592',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1276343229',owner_user_name='tempest-VolumesActionsTest-1276343229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:12:52Z,user_data=None,user_id='39adb4a06ee64e4ab6206842b79f5e51',uuid=2e94785d-54bf-499f-a06c-9b96ff7717bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converting VIF {"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f3:50,bridge_name='br-int',has_traffic_filtering=True,id=97ed6c86-f21e-466d-8b6a-393ddec792b6,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ed6c86-f2') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e94785d-54bf-499f-a06c-9b96ff7717bc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:12:54 user nova-compute[76049]:   <uuid>2e94785d-54bf-499f-a06c-9b96ff7717bc</uuid>
Nov 15 11:12:54 user nova-compute[76049]:   <name>instance-0000000f</name>
Nov 15 11:12:54 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:12:54 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:12:54 user nova-compute[76049]:   <metadata>
Nov 15 11:12:54 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:12:54 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:12:54 user nova-compute[76049]:       <nova:name>tempest-VolumesActionsTest-instance-909721055</nova:name>
Nov 15 11:12:54 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:12:53</nova:creationTime>
Nov 15 11:12:54 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:12:54 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:12:54 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:12:54 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:12:54 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:12:54 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:12:54 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:12:54 user nova-compute[76049]:       <nova:owner>
Nov 15 11:12:54 user nova-compute[76049]:         <nova:user uuid="39adb4a06ee64e4ab6206842b79f5e51">tempest-VolumesActionsTest-1276343229-project-member</nova:user>
Nov 15 11:12:54 user nova-compute[76049]:         <nova:project uuid="5e58ca5ef511414d9faadad3a3ad8279">tempest-VolumesActionsTest-1276343229</nova:project>
Nov 15 11:12:54 user nova-compute[76049]:       </nova:owner>
Nov 15 11:12:54 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:12:54 user nova-compute[76049]:       <nova:ports>
Nov 15 11:12:54 user nova-compute[76049]:         <nova:port uuid="97ed6c86-f21e-466d-8b6a-393ddec792b6">
Nov 15 11:12:54 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:12:54 user nova-compute[76049]:         </nova:port>
Nov 15 11:12:54 user nova-compute[76049]:       </nova:ports>
Nov 15 11:12:54 user nova-compute[76049]:     </nova:instance>
Nov 15 11:12:54 user nova-compute[76049]:   </metadata>
Nov 15 11:12:54 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:12:54 user nova-compute[76049]:     <system>
Nov 15 11:12:54 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:12:54 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:12:54 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:12:54 user nova-compute[76049]:       <entry name="serial">2e94785d-54bf-499f-a06c-9b96ff7717bc</entry>
Nov 15 11:12:54 user nova-compute[76049]:       <entry name="uuid">2e94785d-54bf-499f-a06c-9b96ff7717bc</entry>
Nov 15 11:12:54 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:12:54 user nova-compute[76049]:     </system>
Nov 15 11:12:54 user nova-compute[76049]:   </sysinfo>
Nov 15 11:12:54 user nova-compute[76049]:   <os>
Nov 15 11:12:54 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:12:54 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:12:54 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:12:54 user nova-compute[76049]:   </os>
Nov 15 11:12:54 user nova-compute[76049]:   <features>
Nov 15 11:12:54 user nova-compute[76049]:     <acpi/>
Nov 15 11:12:54 user nova-compute[76049]:     <apic/>
Nov 15 11:12:54 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:12:54 user nova-compute[76049]:   </features>
Nov 15 11:12:54 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:12:54 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:12:54 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:12:54 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:12:54 user nova-compute[76049]:   </clock>
Nov 15 11:12:54 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:12:54 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:12:54 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:12:54 user nova-compute[76049]:   </cpu>
Nov 15 11:12:54 user nova-compute[76049]:   <devices>
Nov 15 11:12:54 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:12:54 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:12:54 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk"/>
Nov 15 11:12:54 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:12:54 user nova-compute[76049]:     </disk>
Nov 15 11:12:54 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:12:54 user nova-compute[76049]:       <mac address="fa:16:3e:a5:f3:50"/>
Nov 15 11:12:54 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:12:54 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:12:54 user nova-compute[76049]:       <target dev="tap97ed6c86-f2"/>
Nov 15 11:12:54 user nova-compute[76049]:     </interface>
Nov 15 11:12:54 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:12:54 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/console.log" append="off"/>
Nov 15 11:12:54 user nova-compute[76049]:     </serial>
Nov 15 11:12:54 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:12:54 user nova-compute[76049]:     <video>
Nov 15 11:12:54 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:12:54 user nova-compute[76049]:     </video>
Nov 15 11:12:54 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:12:54 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:12:54 user nova-compute[76049]:     </rng>
Nov 15 11:12:54 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:12:54 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:12:54 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:12:54 user nova-compute[76049]:     </memballoon>
Nov 15 11:12:54 user nova-compute[76049]:   </devices>
Nov 15 11:12:54 user nova-compute[76049]: </domain>
Nov 15 11:12:54 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-909721055',display_name='tempest-VolumesActionsTest-instance-909721055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-909721055',id=15,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e58ca5ef511414d9faadad3a3ad8279',ramdisk_id='',reservation_id='r-s15fj592',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1276343229',owner_user_name='tempest-VolumesActionsTest-1276343229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:12:52Z,user_data=None,user_id='39adb4a06ee64e4ab6206842b79f5e51',uuid=2e94785d-54bf-499f-a06c-9b96ff7717bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converting VIF {"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f3:50,bridge_name='br-int',has_traffic_filtering=True,id=97ed6c86-f21e-466d-8b6a-393ddec792b6,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ed6c86-f2') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG os_vif [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f3:50,bridge_name='br-int',has_traffic_filtering=True,id=97ed6c86-f21e-466d-8b6a-393ddec792b6,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ed6c86-f2') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc36ccb7-b0c7-5771-9877-82f6ea734bd2', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97ed6c86-f2, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97ed6c86-f2, col_values=(('qos', UUID('8d4e2ab2-8c57-4d98-aebe-595b851bc469')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97ed6c86-f2, col_values=(('external_ids', {'iface-id': '97ed6c86-f21e-466d-8b6a-393ddec792b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:f3:50', 'vm-uuid': '2e94785d-54bf-499f-a06c-9b96ff7717bc'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:54 user nova-compute[76049]: INFO os_vif [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f3:50,bridge_name='br-int',has_traffic_filtering=True,id=97ed6c86-f21e-466d-8b6a-393ddec792b6,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ed6c86-f2')
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] No VIF found with MAC fa:16:3e:a5:f3:50, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.network.neutron [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Updated VIF entry in instance network info cache for port 97ed6c86-f21e-466d-8b6a-393ddec792b6. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG nova.network.neutron [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Updating instance_info_cache with network_info: [{"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:12:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dbc6ee5a-2477-484a-9476-5a081041f522 req-661c5306-6790-4273-b031-2c6c136c3eb7 service nova] Releasing lock "refresh_cache-2e94785d-54bf-499f-a06c-9b96ff7717bc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-3cd18074-b8f3-4a3a-b411-6ea9ed28f2fd req-d7f0f50c-8ea9-4eb7-978f-53e7976e7cc7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received event network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3cd18074-b8f3-4a3a-b411-6ea9ed28f2fd req-d7f0f50c-8ea9-4eb7-978f-53e7976e7cc7 service nova] Acquiring lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3cd18074-b8f3-4a3a-b411-6ea9ed28f2fd req-d7f0f50c-8ea9-4eb7-978f-53e7976e7cc7 service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3cd18074-b8f3-4a3a-b411-6ea9ed28f2fd req-d7f0f50c-8ea9-4eb7-978f-53e7976e7cc7 service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-3cd18074-b8f3-4a3a-b411-6ea9ed28f2fd req-d7f0f50c-8ea9-4eb7-978f-53e7976e7cc7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] No waiting events found dispatching network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:55 user nova-compute[76049]: WARNING nova.compute.manager [req-3cd18074-b8f3-4a3a-b411-6ea9ed28f2fd req-d7f0f50c-8ea9-4eb7-978f-53e7976e7cc7 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received unexpected event network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 for instance with vm_state building and task_state spawning.
Nov 15 11:12:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-39386877-b0f1-4b10-bff0-886f5433faaa req-6fb2edcb-5989-4448-8092-8ec07cbb80cb service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received event network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-39386877-b0f1-4b10-bff0-886f5433faaa req-6fb2edcb-5989-4448-8092-8ec07cbb80cb service nova] Acquiring lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-39386877-b0f1-4b10-bff0-886f5433faaa req-6fb2edcb-5989-4448-8092-8ec07cbb80cb service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-39386877-b0f1-4b10-bff0-886f5433faaa req-6fb2edcb-5989-4448-8092-8ec07cbb80cb service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-39386877-b0f1-4b10-bff0-886f5433faaa req-6fb2edcb-5989-4448-8092-8ec07cbb80cb service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] No waiting events found dispatching network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:12:58 user nova-compute[76049]: WARNING nova.compute.manager [req-39386877-b0f1-4b10-bff0-886f5433faaa req-6fb2edcb-5989-4448-8092-8ec07cbb80cb service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received unexpected event network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 for instance with vm_state building and task_state spawning.
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:12:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Instance spawned successfully.
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:12:58 user nova-compute[76049]: INFO nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 15 11:12:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:12:58 user nova-compute[76049]: INFO nova.compute.manager [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Took 6.96 seconds to build instance.
Nov 15 11:12:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9ca88650-fda7-41e0-8af2-1a4f7bd586d6 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.054s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:12:59 user nova-compute[76049]: INFO nova.compute.manager [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Terminating instance
Nov 15 11:12:59 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:12:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-18ecdc58-652f-412a-9516-97e1564d16ca req-b5809a2a-2078-45a3-8099-9553b1a840db service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-unplugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-18ecdc58-652f-412a-9516-97e1564d16ca req-b5809a2a-2078-45a3-8099-9553b1a840db service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-18ecdc58-652f-412a-9516-97e1564d16ca req-b5809a2a-2078-45a3-8099-9553b1a840db service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-18ecdc58-652f-412a-9516-97e1564d16ca req-b5809a2a-2078-45a3-8099-9553b1a840db service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-18ecdc58-652f-412a-9516-97e1564d16ca req-b5809a2a-2078-45a3-8099-9553b1a840db service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-unplugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-18ecdc58-652f-412a-9516-97e1564d16ca req-b5809a2a-2078-45a3-8099-9553b1a840db service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-unplugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:13:00 user nova-compute[76049]: INFO nova.compute.claims [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Claim successful on node user
Nov 15 11:13:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Instance destroyed successfully.
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lazy-loading 'resources' on Instance uuid 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102972007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102972007',id=6,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoTRMT8whra2MvUmQ1exhcdk4eut9oR5EMHkEd52bnP/5ATOb61jNKs5/neszD6m4TH+J1K6eajkVQp8ex02YOj9VfgC1x7/KtpTtZ54b55FPHQXlxz57PidVs4jpMxkg==',key_name='tempest-keypair-2069374881',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01388fdbea2f40b38a8c4dd5f8c922c9',ramdisk_id='',reservation_id='r-nywgf35m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-995763535',owner_user_name='tempest-TaggedAttachmentsTest-995763535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee64d748ff8940748cbddf050539088c',uuid=60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converting VIF {"id": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "address": "fa:16:3e:da:28:bc", "network": {"id": "77323d6c-f42c-4ec3-95a1-a6e5c809c467", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-36983632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01388fdbea2f40b38a8c4dd5f8c922c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9f20e6-2c", "ovs_interfaceid": "3b9f20e6-2c85-4c46-bf59-4919ee8731ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:28:bc,bridge_name='br-int',has_traffic_filtering=True,id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab,network=Network(77323d6c-f42c-4ec3-95a1-a6e5c809c467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9f20e6-2c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG os_vif [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:28:bc,bridge_name='br-int',has_traffic_filtering=True,id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab,network=Network(77323d6c-f42c-4ec3-95a1-a6e5c809c467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9f20e6-2c') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b9f20e6-2c, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=646bb8fb-cd29-4ef6-bf28-d7ea7d27cb60) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:00 user nova-compute[76049]: INFO os_vif [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:28:bc,bridge_name='br-int',has_traffic_filtering=True,id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab,network=Network(77323d6c-f42c-4ec3-95a1-a6e5c809c467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9f20e6-2c')
Nov 15 11:13:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Deleting instance files /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a_del
Nov 15 11:13:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Deletion of /opt/stack/data/nova/instances/60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a_del complete
Nov 15 11:13:00 user nova-compute[76049]: INFO nova.compute.manager [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 15 11:13:00 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:00 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.network.neutron [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:13:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.policy [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd949070af48c5b42ef0e67e9e241f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8217ae2ae946aeadc1d3d46456d39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:13:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Creating image(s)
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "/opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "/opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "/opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.206s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.216s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk 1073741824" returned: 0 in 0.098s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.network.neutron [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Successfully created port: 3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:13:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Cannot resize image /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Ensure instance console log exists: /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-1f2fbec1-cfdc-4552-8cad-fbe3dd2dec99 req-cfa81b7b-7bec-48e6-862a-4150e6980b1f service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1f2fbec1-cfdc-4552-8cad-fbe3dd2dec99 req-cfa81b7b-7bec-48e6-862a-4150e6980b1f service nova] Acquiring lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1f2fbec1-cfdc-4552-8cad-fbe3dd2dec99 req-cfa81b7b-7bec-48e6-862a-4150e6980b1f service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1f2fbec1-cfdc-4552-8cad-fbe3dd2dec99 req-cfa81b7b-7bec-48e6-862a-4150e6980b1f service nova] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-1f2fbec1-cfdc-4552-8cad-fbe3dd2dec99 req-cfa81b7b-7bec-48e6-862a-4150e6980b1f service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] No waiting events found dispatching network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:02 user nova-compute[76049]: WARNING nova.compute.manager [req-1f2fbec1-cfdc-4552-8cad-fbe3dd2dec99 req-cfa81b7b-7bec-48e6-862a-4150e6980b1f service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received unexpected event network-vif-plugged-3b9f20e6-2c85-4c46-bf59-4919ee8731ab for instance with vm_state active and task_state deleting.
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Successfully updated port: 3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquired lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:13:02 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Took 1.96 seconds to deallocate network for instance.
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-2537ff56-4e7b-4848-b9ba-8193a1343bbc req-a21dc9b0-2b75-4310-b892-bdda1d513069 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Received event network-vif-deleted-3b9f20e6-2c85-4c46-bf59-4919ee8731ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:02 user nova-compute[76049]: INFO nova.compute.manager [req-2537ff56-4e7b-4848-b9ba-8193a1343bbc req-a21dc9b0-2b75-4310-b892-bdda1d513069 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Neutron deleted interface 3b9f20e6-2c85-4c46-bf59-4919ee8731ab; detaching it from the instance and deleting it from the info cache
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-2537ff56-4e7b-4848-b9ba-8193a1343bbc req-a21dc9b0-2b75-4310-b892-bdda1d513069 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-2537ff56-4e7b-4848-b9ba-8193a1343bbc req-a21dc9b0-2b75-4310-b892-bdda1d513069 service nova] [instance: 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a] Detach interface failed, port_id=3b9f20e6-2c85-4c46-bf59-4919ee8731ab, reason: Instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:03 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Deleted allocations for instance 60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Updating instance_info_cache with network_info: [{"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Releasing lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Instance network_info: |[{"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Start _get_guest_xml network_info=[{"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:13:03 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:03 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1584705378',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1584705378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1584705',id=16,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyDMd9NO7g/FqO6k302ZwUiEuhv7verOIVLzKMwcWX7MRxv3h8TrNGo9RFoFaIGzYcDiZWz89cziZsle2aSERea8pe+lK32WfRsAy1lZ2dPey85BnLUWq+jS/TtMiDaAQ==',key_name='tempest-keypair-643396037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc8217ae2ae946aeadc1d3d46456d39f',ramdisk_id='',reservation_id='r-n8jra204',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1237771201',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd949070af48c5b42ef0e67e9e241f',uuid=e85673b8-ef01-4635-9b47-c4935778dba4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Converting VIF {"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:7a:15,bridge_name='br-int',has_traffic_filtering=True,id=3ec8688b-5908-4fa1-9ac2-8b707adf08f1,network=Network(6b77f575-7e76-4391-93e5-da4c3ebb6226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec8688b-59') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lazy-loading 'pci_devices' on Instance uuid e85673b8-ef01-4635-9b47-c4935778dba4 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed0ec7e0-cce4-49c5-8776-5f7646a74fe5 tempest-TaggedAttachmentsTest-995763535 tempest-TaggedAttachmentsTest-995763535-project-member] Lock "60f2f49c-4b9c-4f6d-b1a3-1d2f67c7de9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.699s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:13:03 user nova-compute[76049]:   <uuid>e85673b8-ef01-4635-9b47-c4935778dba4</uuid>
Nov 15 11:13:03 user nova-compute[76049]:   <name>instance-00000010</name>
Nov 15 11:13:03 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:13:03 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:13:03 user nova-compute[76049]:   <metadata>
Nov 15 11:13:03 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:13:03 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:13:03 user nova-compute[76049]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1584705378</nova:name>
Nov 15 11:13:03 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:13:03</nova:creationTime>
Nov 15 11:13:03 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:13:03 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:13:03 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:13:03 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:13:03 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:13:03 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:13:03 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:13:03 user nova-compute[76049]:       <nova:owner>
Nov 15 11:13:03 user nova-compute[76049]:         <nova:user uuid="5bbd949070af48c5b42ef0e67e9e241f">tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member</nova:user>
Nov 15 11:13:03 user nova-compute[76049]:         <nova:project uuid="cc8217ae2ae946aeadc1d3d46456d39f">tempest-TestServerVolumeAttachScenarioOldVersion-1237771201</nova:project>
Nov 15 11:13:03 user nova-compute[76049]:       </nova:owner>
Nov 15 11:13:03 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:13:03 user nova-compute[76049]:       <nova:ports>
Nov 15 11:13:03 user nova-compute[76049]:         <nova:port uuid="3ec8688b-5908-4fa1-9ac2-8b707adf08f1">
Nov 15 11:13:03 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 11:13:03 user nova-compute[76049]:         </nova:port>
Nov 15 11:13:03 user nova-compute[76049]:       </nova:ports>
Nov 15 11:13:03 user nova-compute[76049]:     </nova:instance>
Nov 15 11:13:03 user nova-compute[76049]:   </metadata>
Nov 15 11:13:03 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:13:03 user nova-compute[76049]:     <system>
Nov 15 11:13:03 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:13:03 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:13:03 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:13:03 user nova-compute[76049]:       <entry name="serial">e85673b8-ef01-4635-9b47-c4935778dba4</entry>
Nov 15 11:13:03 user nova-compute[76049]:       <entry name="uuid">e85673b8-ef01-4635-9b47-c4935778dba4</entry>
Nov 15 11:13:03 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:13:03 user nova-compute[76049]:     </system>
Nov 15 11:13:03 user nova-compute[76049]:   </sysinfo>
Nov 15 11:13:03 user nova-compute[76049]:   <os>
Nov 15 11:13:03 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:13:03 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:13:03 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:13:03 user nova-compute[76049]:   </os>
Nov 15 11:13:03 user nova-compute[76049]:   <features>
Nov 15 11:13:03 user nova-compute[76049]:     <acpi/>
Nov 15 11:13:03 user nova-compute[76049]:     <apic/>
Nov 15 11:13:03 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:13:03 user nova-compute[76049]:   </features>
Nov 15 11:13:03 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:13:03 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:13:03 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:13:03 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:13:03 user nova-compute[76049]:   </clock>
Nov 15 11:13:03 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:13:03 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:13:03 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:13:03 user nova-compute[76049]:   </cpu>
Nov 15 11:13:03 user nova-compute[76049]:   <devices>
Nov 15 11:13:03 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:13:03 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:13:03 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk"/>
Nov 15 11:13:03 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:13:03 user nova-compute[76049]:     </disk>
Nov 15 11:13:03 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:13:03 user nova-compute[76049]:       <mac address="fa:16:3e:74:7a:15"/>
Nov 15 11:13:03 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:03 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:13:03 user nova-compute[76049]:       <target dev="tap3ec8688b-59"/>
Nov 15 11:13:03 user nova-compute[76049]:     </interface>
Nov 15 11:13:03 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:13:03 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/console.log" append="off"/>
Nov 15 11:13:03 user nova-compute[76049]:     </serial>
Nov 15 11:13:03 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:13:03 user nova-compute[76049]:     <video>
Nov 15 11:13:03 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:03 user nova-compute[76049]:     </video>
Nov 15 11:13:03 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:13:03 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:13:03 user nova-compute[76049]:     </rng>
Nov 15 11:13:03 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:13:03 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:13:03 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:13:03 user nova-compute[76049]:     </memballoon>
Nov 15 11:13:03 user nova-compute[76049]:   </devices>
Nov 15 11:13:03 user nova-compute[76049]: </domain>
Nov 15 11:13:03 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1584705378',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1584705378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1584705',id=16,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyDMd9NO7g/FqO6k302ZwUiEuhv7verOIVLzKMwcWX7MRxv3h8TrNGo9RFoFaIGzYcDiZWz89cziZsle2aSERea8pe+lK32WfRsAy1lZ2dPey85BnLUWq+jS/TtMiDaAQ==',key_name='tempest-keypair-643396037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc8217ae2ae946aeadc1d3d46456d39f',ramdisk_id='',reservation_id='r-n8jra204',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1237771201',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd949070af48c5b42ef0e67e9e241f',uuid=e85673b8-ef01-4635-9b47-c4935778dba4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Converting VIF {"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:7a:15,bridge_name='br-int',has_traffic_filtering=True,id=3ec8688b-5908-4fa1-9ac2-8b707adf08f1,network=Network(6b77f575-7e76-4391-93e5-da4c3ebb6226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec8688b-59') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG os_vif [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:7a:15,bridge_name='br-int',has_traffic_filtering=True,id=3ec8688b-5908-4fa1-9ac2-8b707adf08f1,network=Network(6b77f575-7e76-4391-93e5-da4c3ebb6226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec8688b-59') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '294723b5-c791-570c-a5fe-fc8ee4f30364', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ec8688b-59, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ec8688b-59, col_values=(('qos', UUID('bc37f7bf-6c40-46c4-8b1f-ada75e022910')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ec8688b-59, col_values=(('external_ids', {'iface-id': '3ec8688b-5908-4fa1-9ac2-8b707adf08f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:7a:15', 'vm-uuid': 'e85673b8-ef01-4635-9b47-c4935778dba4'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:03 user nova-compute[76049]: INFO os_vif [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:7a:15,bridge_name='br-int',has_traffic_filtering=True,id=3ec8688b-5908-4fa1-9ac2-8b707adf08f1,network=Network(6b77f575-7e76-4391-93e5-da4c3ebb6226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec8688b-59')
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:13:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] No VIF found with MAC fa:16:3e:74:7a:15, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:13:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-changed-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Refreshing instance network info cache due to event network-changed-3ec8688b-5908-4fa1-9ac2-8b707adf08f1. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:13:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] Acquiring lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] Acquired lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:04 user nova-compute[76049]: DEBUG nova.network.neutron [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Refreshing network info cache for port 3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:13:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG nova.network.neutron [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Updated VIF entry in instance network info cache for port 3ec8688b-5908-4fa1-9ac2-8b707adf08f1. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG nova.network.neutron [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Updating instance_info_cache with network_info: [{"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd65a0d7-01cf-4f91-931d-caf78c617e8e req-91ba5a5e-d8f4-4f7f-bfba-3ae42d9b4c66 service nova] Releasing lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-fcc79c91-4818-494a-905a-f2443d3b0447 req-1c6e1465-79c9-4d32-ad5d-3894bb8362c0 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fcc79c91-4818-494a-905a-f2443d3b0447 req-1c6e1465-79c9-4d32-ad5d-3894bb8362c0 service nova] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fcc79c91-4818-494a-905a-f2443d3b0447 req-1c6e1465-79c9-4d32-ad5d-3894bb8362c0 service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fcc79c91-4818-494a-905a-f2443d3b0447 req-1c6e1465-79c9-4d32-ad5d-3894bb8362c0 service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-fcc79c91-4818-494a-905a-f2443d3b0447 req-1c6e1465-79c9-4d32-ad5d-3894bb8362c0 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] No waiting events found dispatching network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:05 user nova-compute[76049]: WARNING nova.compute.manager [req-fcc79c91-4818-494a-905a-f2443d3b0447 req-1c6e1465-79c9-4d32-ad5d-3894bb8362c0 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received unexpected event network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 for instance with vm_state building and task_state spawning.
Nov 15 11:13:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:06 user nova-compute[76049]: INFO nova.compute.manager [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Detaching volume f3be9b12-bb41-49f6-9488-494645bd23c4
Nov 15 11:13:06 user nova-compute[76049]: INFO nova.virt.block_device [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Attempting to driver detach volume f3be9b12-bb41-49f6-9488-494645bd23c4 from mountpoint /dev/vdb
Nov 15 11:13:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Attempting to detach device vdb from instance 257a8a67-6214-4cee-a280-dff1a1420f5f from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:13:06 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:13:06 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:13:06 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:13:06 user nova-compute[76049]:   <serial>f3be9b12-bb41-49f6-9488-494645bd23c4</serial>
Nov 15 11:13:06 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:13:06 user nova-compute[76049]: </disk>
Nov 15 11:13:06 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:13:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully detached device vdb from instance 257a8a67-6214-4cee-a280-dff1a1420f5f from the persistent domain config.
Nov 15 11:13:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 257a8a67-6214-4cee-a280-dff1a1420f5f from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:13:06 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:13:06 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:13:06 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:13:06 user nova-compute[76049]:   <serial>f3be9b12-bb41-49f6-9488-494645bd23c4</serial>
Nov 15 11:13:06 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:13:06 user nova-compute[76049]: </disk>
Nov 15 11:13:06 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 257a8a67-6214-4cee-a280-dff1a1420f5f {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:13:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:13:07 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Instance spawned successfully.
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:07 user nova-compute[76049]: INFO nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:13:07 user nova-compute[76049]: INFO nova.compute.manager [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Took 7.14 seconds to build instance.
Nov 15 11:13:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-835aff87-b8d0-46cd-823b-e8e4c90cfeda tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.256s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-11e87e9e-bf8b-44cd-97ee-b885e1d35e8f req-02740e38-3e2c-4e0b-b824-7f23e34646b7 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-11e87e9e-bf8b-44cd-97ee-b885e1d35e8f req-02740e38-3e2c-4e0b-b824-7f23e34646b7 service nova] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-11e87e9e-bf8b-44cd-97ee-b885e1d35e8f req-02740e38-3e2c-4e0b-b824-7f23e34646b7 service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-11e87e9e-bf8b-44cd-97ee-b885e1d35e8f req-02740e38-3e2c-4e0b-b824-7f23e34646b7 service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-11e87e9e-bf8b-44cd-97ee-b885e1d35e8f req-02740e38-3e2c-4e0b-b824-7f23e34646b7 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] No waiting events found dispatching network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:07 user nova-compute[76049]: WARNING nova.compute.manager [req-11e87e9e-bf8b-44cd-97ee-b885e1d35e8f req-02740e38-3e2c-4e0b-b824-7f23e34646b7 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received unexpected event network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 for instance with vm_state active and task_state None.
Nov 15 11:13:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:10 user nova-compute[76049]: INFO nova.compute.manager [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Unshelving
Nov 15 11:13:10 user nova-compute[76049]: INFO nova.virt.block_device [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Booting with volume b330ded1-6ebc-420f-84a8-2f095f0e1a2c at /dev/vdc
Nov 15 11:13:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[06acf251-9160-4c00-9532-68b8360c7dfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[708da0ad-761e-48e8-bb70-a15e3af324f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca48c1-39a7-4c1f-8451-c3946c25e68b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[635a1d5f-a087-4f0d-9517-cc64e4e4994a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:13:10 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:13:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c557160d-b68a-4e20-af2d-2e33b384e48f]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:13:10 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating existing volume attachment record: bab2153c-2f44-412f-897c-dd502d3fd533 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:13:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'pci_requests' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'numa_topology' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:13:16 user nova-compute[76049]: INFO nova.compute.claims [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Claim successful on node user
Nov 15 11:13:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:17 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:17 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:17 user nova-compute[76049]: INFO nova.network.neutron [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating port b1bdc1ea-ee41-4895-8cfd-47055753f58c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing instance network info cache due to event network-changed-b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] Acquiring lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:13:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Creating image(s)
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'trusted_certs' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] Acquired lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Refreshing network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG nova.objects.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<d23b5032-89df-47d6-93fa-496bd3d5671c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.part --force-share --output=json" returned: 0 in 0.198s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.virt.images [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] 688d7e77-3501-43d1-9f90-4d1aaf9ab3b2 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.part /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updated VIF entry in instance network info cache for port b1bdc1ea-ee41-4895-8cfd-47055753f58c. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-689f03fa-2c33-4e7f-81cc-4c4d3a05516a req-15cfbc80-3b3b-4278-b775-fadc41ca0edb service nova] Releasing lock "refresh_cache-d23b5032-89df-47d6-93fa-496bd3d5671c" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updating instance_info_cache with network_info: [{"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.part /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.converted" returned: 0 in 0.760s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-c14698a2-4375-4eff-b590-da9bd6b705c3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:20 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.318s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c,backing_fmt=raw /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c,backing_fmt=raw /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk 1073741824" returned: 0 in 0.099s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'migration_context' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG nova.objects.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<d23b5032-89df-47d6-93fa-496bd3d5671c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:13:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Rebasing disk image.
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc -F raw /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdl (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:13:24 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:24 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7733MB free_disk=25.544876098632812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance cc582aae-00f7-4c3d-b551-a70aac92d7ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c14698a2-4375-4eff-b590-da9bd6b705c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 257a8a67-6214-4cee-a280-dff1a1420f5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance e5b4194d-37cb-47f2-96a1-efe798985010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 2e94785d-54bf-499f-a06c-9b96ff7717bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance e85673b8-ef01-4635-9b47-c4935778dba4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (260aaae9-3cc3-45eb-be88-21bcfcddde10): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc -F raw /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk" returned: 0 in 3.045s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Ensure instance console log exists: /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Start _get_guest_xml network_info=[{"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ac651ab776e6e3b78af427733dd6a6d7',container_format='bare',created_at=2023-11-15T11:11:17Z,direct_url=<?>,disk_format='qcow2',id=688d7e77-3501-43d1-9f90-4d1aaf9ab3b2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-393013812-shelved',owner='4977c566adae433e8780d44d86f18757',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T11:11:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOsYCdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd23b5032-89df-47d6-93fa-496bd3d5671c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b330ded1-6ebc-420f-84a8-2f095f0e1a2c', 'serial': 'b330ded1-6ebc-420f-84a8-2f095f0e1a2c'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'bab2153c-2f44-412f-897c-dd502d3fd533', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:13:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ac651ab776e6e3b78af427733dd6a6d7',container_format='bare',created_at=2023-11-15T11:11:17Z,direct_url=<?>,disk_format='qcow2',id=688d7e77-3501-43d1-9f90-4d1aaf9ab3b2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-393013812-shelved',owner='4977c566adae433e8780d44d86f18757',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T11:11:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'vcpu_model' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.objects.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<d23b5032-89df-47d6-93fa-496bd3d5671c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOsYCdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:13:25 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:13:25 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:13:25 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:13:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260" returned: 21 in 0.121s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc732398-9070-4da4-9fee-561fecfb3d03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:13:25 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc92b2-b979-4ad4-9267-9886d25ca422]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c] added
Nov 15 11:13:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ae98c8-d064-4469-b933-23bb18fb166c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[94123308-f096-4b9b-9e5c-9d4516edb661]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOsYCdMf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOsYCdMf" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.091s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[147b0a01-c5bb-49b5-8ccc-79537989967f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JOsYCdMf'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a7891d-93ff-4d07-b5ac-67dac8897802]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e854c99-3d0b-4a40-8f56-3cec99c8217d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:25 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:13:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:25 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:13:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d35086-2a66-4d52-b9d8-276edc43ffbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260]
Nov 15 11:13:25 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260] successful.
Nov 15 11:13:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfe11b5-e7e5-4eeb-8864-ab97f6ad5005]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27fde1-ccda-4b23-93bd-01e4243a2bfd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:25 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:13:25 user nova-compute[76049]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:25 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:13:25 user nova-compute[76049]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab9d3c-4ba3-4b3a-95a8-abe6ed0b476b]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOsYCdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:13:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:26 user nova-compute[76049]: INFO nova.compute.manager [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Terminating instance
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26639353762663136', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639353762663136', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-393013812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-393013812',id=2,image_ref='688d7e77-3501-43d1-9f90-4d1aaf9ab3b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1888008997',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-q1vxyx50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member',shelved_at='2023-11-15T11:11:21.880716',shelved_host='user',shelved_image_id='688d7e77-3501-43d1-9f90-4d1aaf9ab3b2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=d23b5032-89df-47d6-93fa-496bd3d5671c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'pci_devices' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.objects.base [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<d23b5032-89df-47d6-93fa-496bd3d5671c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:13:26 user nova-compute[76049]:   <uuid>d23b5032-89df-47d6-93fa-496bd3d5671c</uuid>
Nov 15 11:13:26 user nova-compute[76049]:   <name>instance-00000002</name>
Nov 15 11:13:26 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:13:26 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:13:26 user nova-compute[76049]:   <metadata>
Nov 15 11:13:26 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:13:26 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:13:26 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-393013812</nova:name>
Nov 15 11:13:26 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:13:25</nova:creationTime>
Nov 15 11:13:26 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:13:26 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:13:26 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:13:26 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:13:26 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:13:26 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:13:26 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:13:26 user nova-compute[76049]:       <nova:owner>
Nov 15 11:13:26 user nova-compute[76049]:         <nova:user uuid="fd3cb19baf044c1ca816581576c5c243">tempest-AttachVolumeShelveTestJSON-10410443-project-member</nova:user>
Nov 15 11:13:26 user nova-compute[76049]:         <nova:project uuid="4977c566adae433e8780d44d86f18757">tempest-AttachVolumeShelveTestJSON-10410443</nova:project>
Nov 15 11:13:26 user nova-compute[76049]:       </nova:owner>
Nov 15 11:13:26 user nova-compute[76049]:       <nova:root type="image" uuid="688d7e77-3501-43d1-9f90-4d1aaf9ab3b2"/>
Nov 15 11:13:26 user nova-compute[76049]:       <nova:ports>
Nov 15 11:13:26 user nova-compute[76049]:         <nova:port uuid="b1bdc1ea-ee41-4895-8cfd-47055753f58c">
Nov 15 11:13:26 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 11:13:26 user nova-compute[76049]:         </nova:port>
Nov 15 11:13:26 user nova-compute[76049]:       </nova:ports>
Nov 15 11:13:26 user nova-compute[76049]:     </nova:instance>
Nov 15 11:13:26 user nova-compute[76049]:   </metadata>
Nov 15 11:13:26 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:13:26 user nova-compute[76049]:     <system>
Nov 15 11:13:26 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:13:26 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:13:26 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:13:26 user nova-compute[76049]:       <entry name="serial">d23b5032-89df-47d6-93fa-496bd3d5671c</entry>
Nov 15 11:13:26 user nova-compute[76049]:       <entry name="uuid">d23b5032-89df-47d6-93fa-496bd3d5671c</entry>
Nov 15 11:13:26 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:13:26 user nova-compute[76049]:     </system>
Nov 15 11:13:26 user nova-compute[76049]:   </sysinfo>
Nov 15 11:13:26 user nova-compute[76049]:   <os>
Nov 15 11:13:26 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:13:26 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:13:26 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:13:26 user nova-compute[76049]:   </os>
Nov 15 11:13:26 user nova-compute[76049]:   <features>
Nov 15 11:13:26 user nova-compute[76049]:     <acpi/>
Nov 15 11:13:26 user nova-compute[76049]:     <apic/>
Nov 15 11:13:26 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:13:26 user nova-compute[76049]:   </features>
Nov 15 11:13:26 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:13:26 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:13:26 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:13:26 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:13:26 user nova-compute[76049]:   </clock>
Nov 15 11:13:26 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:13:26 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:13:26 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:13:26 user nova-compute[76049]:   </cpu>
Nov 15 11:13:26 user nova-compute[76049]:   <devices>
Nov 15 11:13:26 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:13:26 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:13:26 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk"/>
Nov 15 11:13:26 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:13:26 user nova-compute[76049]:     </disk>
Nov 15 11:13:26 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:13:26 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:13:26 user nova-compute[76049]:       <source dev="/dev/sdc"/>
Nov 15 11:13:26 user nova-compute[76049]:       <target dev="vdc" bus="virtio"/>
Nov 15 11:13:26 user nova-compute[76049]:       <serial>b330ded1-6ebc-420f-84a8-2f095f0e1a2c</serial>
Nov 15 11:13:26 user nova-compute[76049]:     </disk>
Nov 15 11:13:26 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:13:26 user nova-compute[76049]:       <mac address="fa:16:3e:11:ea:7e"/>
Nov 15 11:13:26 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:26 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:13:26 user nova-compute[76049]:       <target dev="tapb1bdc1ea-ee"/>
Nov 15 11:13:26 user nova-compute[76049]:     </interface>
Nov 15 11:13:26 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:13:26 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/console.log" append="off"/>
Nov 15 11:13:26 user nova-compute[76049]:     </serial>
Nov 15 11:13:26 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:13:26 user nova-compute[76049]:     <video>
Nov 15 11:13:26 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:26 user nova-compute[76049]:     </video>
Nov 15 11:13:26 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:13:26 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:13:26 user nova-compute[76049]:     </rng>
Nov 15 11:13:26 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:13:26 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:13:26 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:13:26 user nova-compute[76049]:     </memballoon>
Nov 15 11:13:26 user nova-compute[76049]:   </devices>
Nov 15 11:13:26 user nova-compute[76049]: </domain>
Nov 15 11:13:26 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-393013812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-393013812',id=2,image_ref='688d7e77-3501-43d1-9f90-4d1aaf9ab3b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1888008997',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-q1vxyx50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member',shelved_at='2023-11-15T11:11:21.880716',shelved_host='user',shelved_image_id='688d7e77-3501-43d1-9f90-4d1aaf9ab3b2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=d23b5032-89df-47d6-93fa-496bd3d5671c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG os_vif [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a8e72c6-21c5-5997-afef-6a971265f68b', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1bdc1ea-ee, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1bdc1ea-ee, col_values=(('qos', UUID('d1039412-3551-462c-81f1-98474a6549aa')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1bdc1ea-ee, col_values=(('external_ids', {'iface-id': 'b1bdc1ea-ee41-4895-8cfd-47055753f58c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:ea:7e', 'vm-uuid': 'd23b5032-89df-47d6-93fa-496bd3d5671c'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: INFO os_vif [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee')
Nov 15 11:13:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No VIF found with MAC fa:16:3e:11:ea:7e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:13:26 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 257a8a67-6214-4cee-a280-dff1a1420f5f is timed out.
Nov 15 11:13:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully detached device vdb from instance 257a8a67-6214-4cee-a280-dff1a1420f5f from the live domain config.
Nov 15 11:13:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLUJrpqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:13:26 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:13:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:13:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.046s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[809d7041-24d0-4584-9f87-b9befbde76ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:13:27 user nova-compute[76049]: No targets found.
Nov 15 11:13:27 user nova-compute[76049]: iSNS:
Nov 15 11:13:27 user nova-compute[76049]: No targets found.
Nov 15 11:13:27 user nova-compute[76049]: STATIC:
Nov 15 11:13:27 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c
Nov 15 11:13:27 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:13:27 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:13:27 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:13:27 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:13:27 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:13:27 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4
Nov 15 11:13:27 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:13:27 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:13:27 user nova-compute[76049]: FIRMWARE:
Nov 15 11:13:27 user nova-compute[76049]: No targets found.
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:13:27 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:13:27 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805223a-355c-4aa9-b235-87a6cfbde9b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ae1e8d-e94e-4fac-8a0c-88fa540f55e1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:27 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:13:27 user nova-compute[76049]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:27 user nova-compute[76049]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 (non-flash)
Nov 15 11:13:27 user nova-compute[76049]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f628456fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce54b632-57c1-45d6-904e-26c410b49ad4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[334b7533-912d-4e03-883c-d0f5c894a2d0]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f171a780-6abf-41e5-a867-e2bc32d46971]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0350d47-6a82-449f-82c9-370c9950c99e]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd58795-44a6-4676-bdb1-764629405e95]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Instance destroyed successfully.
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.objects.instance [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lazy-loading 'resources' on Instance uuid c14698a2-4375-4eff-b590-da9bd6b705c3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1903236133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455564423',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiooTyBAMDa34L+spwsKuK/KxqusfIwhUiudamwQEO/wUTf8kPInujstho24FharspFIqdn/7mX+Fd8wvkB2FKkESOxD8uzJgNhYyHhArruHSEXQlyv7Qs3FlJBuDislw==',key_name='tempest-keypair-1043338373',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='554876e2455347ea8587eab6d9a5e72a',ramdisk_id='',reservation_id='r-istarf3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1321113087',owner_user_name='tempest-ServerActionsV293TestJSON-1321113087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5ae3fcc46c4fd1834660eb48910332',uuid=c14698a2-4375-4eff-b590-da9bd6b705c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converting VIF {"id": "790cd537-de81-4c38-b956-e7844fe08df4", "address": "fa:16:3e:b6:03:77", "network": {"id": "152d5e3e-7616-40f0-a8c3-a947ec5e9e21", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1788984015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554876e2455347ea8587eab6d9a5e72a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790cd537-de", "ovs_interfaceid": "790cd537-de81-4c38-b956-e7844fe08df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_vif [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap790cd537-de, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6da9605-cc7b-43cb-b44f-38d895032803]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2014d3e-ddd1-4312-8937-dcb7064883aa) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260]
Nov 15 11:13:27 user nova-compute[76049]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4, portal: 172.16.0.220,3260] successful.
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:27 user nova-compute[76049]: INFO os_vif [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:03:77,bridge_name='br-int',has_traffic_filtering=True,id=790cd537-de81-4c38-b956-e7844fe08df4,network=Network(152d5e3e-7616-40f0-a8c3-a947ec5e9e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790cd537-de')
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilEkYyuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:13:27 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abf19a1-a5cc-4e65-ba84-1cbad0adc5e4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== disconnect_volume: return (413ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.026s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9525e78-d73c-4dd5-bbd9-6a952ebb7815]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:13:27 user nova-compute[76049]: No targets found.
Nov 15 11:13:27 user nova-compute[76049]: iSNS:
Nov 15 11:13:27 user nova-compute[76049]: No targets found.
Nov 15 11:13:27 user nova-compute[76049]: STATIC:
Nov 15 11:13:27 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c
Nov 15 11:13:27 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:13:27 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:13:27 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df
Nov 15 11:13:27 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:13:27 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:13:27 user nova-compute[76049]: FIRMWARE:
Nov 15 11:13:27 user nova-compute[76049]: No targets found.
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:13:27 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:13:27 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a61e118-a931-4ec3-9041-5ea59a30dbcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fc421f-94f8-4739-9e40-fab86b4f7fae]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:27 user nova-compute[76049]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df (non-flash)
Nov 15 11:13:27 user nova-compute[76049]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6260759630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df'): ({'sdl'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Removing single pathed devices sdl {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1abd23-a64a-47ae-b318-19b2d846e3d4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[277fb676-80b4-4227-bdc0-3a3dc7cb0c6f]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Flushing IO for device /dev/sdl {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd09c71-e7e7-44a2-b83d-bd0c7dc1e6ab]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.066s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f1d705-1fda-4bda-9ec2-a6ecc7a387f4]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] SCSI volumes sdl have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b868e-5a43-4518-a979-394da50355a8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5fa40-53a4-4419-b0bb-9dc9ffb08734]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260]
Nov 15 11:13:27 user nova-compute[76049]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df, portal: 172.16.0.220,3260] successful.
Nov 15 11:13:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ade6fb4-0436-483a-b3b0-fb4a90adc4df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[308723f8-f5ca-482a-b581-321c6568f724]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] <== disconnect_volume: return (399ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:13:27 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Deleting instance files /opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3_del
Nov 15 11:13:27 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Deletion of /opt/stack/data/nova/instances/c14698a2-4375-4eff-b590-da9bd6b705c3_del complete
Nov 15 11:13:27 user nova-compute[76049]: INFO nova.compute.manager [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Took 1.71 seconds to destroy the instance on the hypervisor.
Nov 15 11:13:27 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:13:27 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-3bdd19e7-69f1-464e-99ca-f2879c53ee9f req-97bb2598-5fe0-4c98-86cd-c9e1143a3a56 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-unplugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3bdd19e7-69f1-464e-99ca-f2879c53ee9f req-97bb2598-5fe0-4c98-86cd-c9e1143a3a56 service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3bdd19e7-69f1-464e-99ca-f2879c53ee9f req-97bb2598-5fe0-4c98-86cd-c9e1143a3a56 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3bdd19e7-69f1-464e-99ca-f2879c53ee9f req-97bb2598-5fe0-4c98-86cd-c9e1143a3a56 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-3bdd19e7-69f1-464e-99ca-f2879c53ee9f req-97bb2598-5fe0-4c98-86cd-c9e1143a3a56 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-unplugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-3bdd19e7-69f1-464e-99ca-f2879c53ee9f req-97bb2598-5fe0-4c98-86cd-c9e1143a3a56 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-unplugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'flavor' on Instance uuid 257a8a67-6214-4cee-a280-dff1a1420f5f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2909d317-b280-4865-ac48-0cd6950638ce tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.344s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.194s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:28 user nova-compute[76049]: INFO nova.compute.manager [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Terminating instance
Nov 15 11:13:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Instance destroyed successfully.
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'resources' on Instance uuid 257a8a67-6214-4cee-a280-dff1a1420f5f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1345929207',display_name='tempest-VolumesSnapshotTestJSON-instance-1345929207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1345929207',id=12,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlJ5ozxaXwFxFKKGgDtk7VF87F9ep16Mu8EyT1Op64krn0Oc1dVDD+dIrR9vnJq6+GDkY1APKOK/4f7NZ2BbzcsMXjQKTn9e5Tw7NNVwTg1c0FhZYJqZ1Jcbgj+WfQfcQ==',key_name='tempest-keypair-1569309691',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df502284cb84433a1ddd5195da15df8',ramdisk_id='',reservation_id='r-wu0pjuam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-753677889',owner_user_name='tempest-VolumesSnapshotTestJSON-753677889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092762011c594cb6b7badf4bbafe513e',uuid=257a8a67-6214-4cee-a280-dff1a1420f5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converting VIF {"id": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "address": "fa:16:3e:21:11:ad", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f86da6-56", "ovs_interfaceid": "a7f86da6-569a-42f5-9489-5ac29a0eee39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:11:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7f86da6-569a-42f5-9489-5ac29a0eee39,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f86da6-56') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_vif [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:11:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7f86da6-569a-42f5-9489-5ac29a0eee39,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f86da6-56') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7f86da6-56, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afe15ae4-986b-4e67-8afe-ad39fce32bbe) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Took 1.73 seconds to deallocate network for instance.
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: INFO os_vif [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:11:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7f86da6-569a-42f5-9489-5ac29a0eee39,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f86da6-56')
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-2b563208-79fa-4fcb-bd25-1da0c71e30ac req-62c38942-a9d5-4526-a1dc-9908163b3847 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-deleted-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLUJrpqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:13:29 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4de184-d124-4a94-ac70-39097fde8c31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:13:29 user nova-compute[76049]: No targets found.
Nov 15 11:13:29 user nova-compute[76049]: iSNS:
Nov 15 11:13:29 user nova-compute[76049]: No targets found.
Nov 15 11:13:29 user nova-compute[76049]: STATIC:
Nov 15 11:13:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c
Nov 15 11:13:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:13:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:13:29 user nova-compute[76049]: FIRMWARE:
Nov 15 11:13:29 user nova-compute[76049]: No targets found.
Nov 15 11:13:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:13:29 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:13:29 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3be9b12-bb41-49f6-9488-494645bd23c4', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[344f52da-7558-45da-8776-c8f688b303cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4645f95-8d01-4e8a-9fd3-479d51fe5f8e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:13:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f628456dfc0>, {}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Disconnecting from: [] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== disconnect_volume: return (100ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:13:29 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Deleting instance files /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f_del
Nov 15 11:13:29 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Deletion of /opt/stack/data/nova/instances/257a8a67-6214-4cee-a280-dff1a1420f5f_del complete
Nov 15 11:13:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:29 user nova-compute[76049]: INFO nova.compute.manager [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 11:13:29 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:13:29 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Acquiring lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] No waiting events found dispatching network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:30 user nova-compute[76049]: WARNING nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Received unexpected event network-vif-plugged-790cd537-de81-4c38-b956-e7844fe08df4 for instance with vm_state active and task_state deleting.
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:30 user nova-compute[76049]: WARNING nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:30 user nova-compute[76049]: WARNING nova.compute.manager [req-3e15366b-62da-4930-a663-ed0f94c1b4fa req-04a0d549-8c2a-4528-b6d9-55ccf0449290 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 11:13:30 user nova-compute[76049]: INFO nova.compute.manager [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Took 1.00 seconds to detach 1 volumes for instance.
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.compute.manager [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] [instance: c14698a2-4375-4eff-b590-da9bd6b705c3] Deleting volume: 1ade6fb4-0436-483a-b3b0-fb4a90adc4df {{(pid=76049) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:30 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Took 0.92 seconds to deallocate network for instance.
Nov 15 11:13:30 user nova-compute[76049]: WARNING nova.volume.cinder [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Attachment 9d462c17-caaf-48fb-9741-beaa7d9aae4f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9d462c17-caaf-48fb-9741-beaa7d9aae4f. (HTTP 404) (Request-ID: req-a9ea9750-15bd-43f2-9be9-20f2781f72e8)
Nov 15 11:13:30 user nova-compute[76049]: INFO nova.compute.manager [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.279s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:31 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Deleted allocations for instance c14698a2-4375-4eff-b590-da9bd6b705c3
Nov 15 11:13:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-80514b55-3af2-4bf6-aeef-7a770d94b3e6 tempest-ServerActionsV293TestJSON-1321113087 tempest-ServerActionsV293TestJSON-1321113087-project-member] Lock "c14698a2-4375-4eff-b590-da9bd6b705c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.133s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:31 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Deleted allocations for instance 257a8a67-6214-4cee-a280-dff1a1420f5f
Nov 15 11:13:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a8b24c9e-8fd3-4426-89f8-f9deeb185ca4 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "257a8a67-6214-4cee-a280-dff1a1420f5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.005s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:13:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance spawned successfully.
Nov 15 11:13:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-47c2d24a-c56a-49b7-b039-468696b7edf5 req-f83892e7-03b7-4643-a689-cb9418e5929f service nova] [instance: 257a8a67-6214-4cee-a280-dff1a1420f5f] Received event network-vif-deleted-a7f86da6-569a-42f5-9489-5ac29a0eee39 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:13:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fe519592-4598-41ff-a503-d777f9cdeb14 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.688s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "25c772f6-5656-46b5-9461-d720314b29ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:13:33 user nova-compute[76049]: INFO nova.compute.claims [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Claim successful on node user
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:13:33 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:13:33 user nova-compute[76049]: DEBUG nova.policy [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c548eac583644342a905b89ee8fc4b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61718ae918a495eadf79664d2ea66c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:13:34 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Creating image(s)
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "/opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "/opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "/opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.192s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk 1073741824" returned: 0 in 0.049s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Cannot resize image /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Ensure instance console log exists: /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Successfully created port: b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Successfully updated port: b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquired lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-changed-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Refreshing instance network info cache due to event network-changed-b35c63a9-bd65-4a46-a9bd-87decd1daeb8. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] Acquiring lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Releasing lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Instance network_info: |[{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] Acquired lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.neutron [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Refreshing network info cache for port b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Start _get_guest_xml network_info=[{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:13:36 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:36 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24798472',display_name='tempest-ServerActionsTestOtherA-server-24798472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24798472',id=17,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-bnkvvjn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=25c772f6-5656-46b5-9461-d720314b29ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=b35c63a9-bd65-4a46-a9bd-87decd1daeb8,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35c63a9-bd') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'pci_devices' on Instance uuid 25c772f6-5656-46b5-9461-d720314b29ae {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:13:36 user nova-compute[76049]:   <uuid>25c772f6-5656-46b5-9461-d720314b29ae</uuid>
Nov 15 11:13:36 user nova-compute[76049]:   <name>instance-00000011</name>
Nov 15 11:13:36 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:13:36 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:13:36 user nova-compute[76049]:   <metadata>
Nov 15 11:13:36 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:13:36 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:13:36 user nova-compute[76049]:       <nova:name>tempest-ServerActionsTestOtherA-server-24798472</nova:name>
Nov 15 11:13:36 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:13:36</nova:creationTime>
Nov 15 11:13:36 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:13:36 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:13:36 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:13:36 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:13:36 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:13:36 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:13:36 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:13:36 user nova-compute[76049]:       <nova:owner>
Nov 15 11:13:36 user nova-compute[76049]:         <nova:user uuid="c548eac583644342a905b89ee8fc4b1a">tempest-ServerActionsTestOtherA-278593450-project-member</nova:user>
Nov 15 11:13:36 user nova-compute[76049]:         <nova:project uuid="a61718ae918a495eadf79664d2ea66c6">tempest-ServerActionsTestOtherA-278593450</nova:project>
Nov 15 11:13:36 user nova-compute[76049]:       </nova:owner>
Nov 15 11:13:36 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:13:36 user nova-compute[76049]:       <nova:ports>
Nov 15 11:13:36 user nova-compute[76049]:         <nova:port uuid="b35c63a9-bd65-4a46-a9bd-87decd1daeb8">
Nov 15 11:13:36 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 11:13:36 user nova-compute[76049]:         </nova:port>
Nov 15 11:13:36 user nova-compute[76049]:       </nova:ports>
Nov 15 11:13:36 user nova-compute[76049]:     </nova:instance>
Nov 15 11:13:36 user nova-compute[76049]:   </metadata>
Nov 15 11:13:36 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:13:36 user nova-compute[76049]:     <system>
Nov 15 11:13:36 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:13:36 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:13:36 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:13:36 user nova-compute[76049]:       <entry name="serial">25c772f6-5656-46b5-9461-d720314b29ae</entry>
Nov 15 11:13:36 user nova-compute[76049]:       <entry name="uuid">25c772f6-5656-46b5-9461-d720314b29ae</entry>
Nov 15 11:13:36 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:13:36 user nova-compute[76049]:     </system>
Nov 15 11:13:36 user nova-compute[76049]:   </sysinfo>
Nov 15 11:13:36 user nova-compute[76049]:   <os>
Nov 15 11:13:36 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:13:36 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:13:36 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:13:36 user nova-compute[76049]:   </os>
Nov 15 11:13:36 user nova-compute[76049]:   <features>
Nov 15 11:13:36 user nova-compute[76049]:     <acpi/>
Nov 15 11:13:36 user nova-compute[76049]:     <apic/>
Nov 15 11:13:36 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:13:36 user nova-compute[76049]:   </features>
Nov 15 11:13:36 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:13:36 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:13:36 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:13:36 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:13:36 user nova-compute[76049]:   </clock>
Nov 15 11:13:36 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:13:36 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:13:36 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:13:36 user nova-compute[76049]:   </cpu>
Nov 15 11:13:36 user nova-compute[76049]:   <devices>
Nov 15 11:13:36 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:13:36 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:13:36 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk"/>
Nov 15 11:13:36 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:13:36 user nova-compute[76049]:     </disk>
Nov 15 11:13:36 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:13:36 user nova-compute[76049]:       <mac address="fa:16:3e:97:cf:d6"/>
Nov 15 11:13:36 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:36 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:13:36 user nova-compute[76049]:       <target dev="tapb35c63a9-bd"/>
Nov 15 11:13:36 user nova-compute[76049]:     </interface>
Nov 15 11:13:36 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:13:36 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/console.log" append="off"/>
Nov 15 11:13:36 user nova-compute[76049]:     </serial>
Nov 15 11:13:36 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:13:36 user nova-compute[76049]:     <video>
Nov 15 11:13:36 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:36 user nova-compute[76049]:     </video>
Nov 15 11:13:36 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:13:36 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:13:36 user nova-compute[76049]:     </rng>
Nov 15 11:13:36 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:13:36 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:13:36 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:13:36 user nova-compute[76049]:     </memballoon>
Nov 15 11:13:36 user nova-compute[76049]:   </devices>
Nov 15 11:13:36 user nova-compute[76049]: </domain>
Nov 15 11:13:36 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24798472',display_name='tempest-ServerActionsTestOtherA-server-24798472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24798472',id=17,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-bnkvvjn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=25c772f6-5656-46b5-9461-d720314b29ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=b35c63a9-bd65-4a46-a9bd-87decd1daeb8,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35c63a9-bd') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG os_vif [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=b35c63a9-bd65-4a46-a9bd-87decd1daeb8,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35c63a9-bd') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30c17a1a-fa17-5ec9-b37d-5c3dbe220dde', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb35c63a9-bd, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb35c63a9-bd, col_values=(('qos', UUID('5661c098-ce82-456c-a6b9-188c0d1bbcc4')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb35c63a9-bd, col_values=(('external_ids', {'iface-id': 'b35c63a9-bd65-4a46-a9bd-87decd1daeb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:cf:d6', 'vm-uuid': '25c772f6-5656-46b5-9461-d720314b29ae'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:36 user nova-compute[76049]: INFO os_vif [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=b35c63a9-bd65-4a46-a9bd-87decd1daeb8,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35c63a9-bd')
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No VIF found with MAC fa:16:3e:97:cf:d6, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.neutron [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updated VIF entry in instance network info cache for port b35c63a9-bd65-4a46-a9bd-87decd1daeb8. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG nova.network.neutron [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fc99e9d3-96dc-4f74-863a-3a7b47d8d067 req-96f2305f-831c-4441-8945-f047568df312 service nova] Releasing lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:37 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:13:37 user nova-compute[76049]: INFO nova.compute.claims [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Claim successful on node user
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-23e4d530-5958-4670-8ced-b5dcbeba73d6 req-877d54f3-7960-4ca0-a8c5-051f71394ca0 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23e4d530-5958-4670-8ced-b5dcbeba73d6 req-877d54f3-7960-4ca0-a8c5-051f71394ca0 service nova] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23e4d530-5958-4670-8ced-b5dcbeba73d6 req-877d54f3-7960-4ca0-a8c5-051f71394ca0 service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23e4d530-5958-4670-8ced-b5dcbeba73d6 req-877d54f3-7960-4ca0-a8c5-051f71394ca0 service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-23e4d530-5958-4670-8ced-b5dcbeba73d6 req-877d54f3-7960-4ca0-a8c5-051f71394ca0 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] No waiting events found dispatching network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:38 user nova-compute[76049]: WARNING nova.compute.manager [req-23e4d530-5958-4670-8ced-b5dcbeba73d6 req-877d54f3-7960-4ca0-a8c5-051f71394ca0 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received unexpected event network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 for instance with vm_state building and task_state spawning.
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:13:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.policy [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '795aee66df224136815061e47764558b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797846ae50ef4815be5175b94f6fc15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:13:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Creating image(s)
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "/opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "/opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "/opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.194s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk 1073741824" returned: 0 in 0.052s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Successfully created port: 91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Cannot resize image /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Ensure instance console log exists: /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-4e09e246-6711-433d-84f0-f31fb1c72bdc req-563d36c5-92fe-4089-acd6-fac8492a28b5 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4e09e246-6711-433d-84f0-f31fb1c72bdc req-563d36c5-92fe-4089-acd6-fac8492a28b5 service nova] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4e09e246-6711-433d-84f0-f31fb1c72bdc req-563d36c5-92fe-4089-acd6-fac8492a28b5 service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4e09e246-6711-433d-84f0-f31fb1c72bdc req-563d36c5-92fe-4089-acd6-fac8492a28b5 service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-4e09e246-6711-433d-84f0-f31fb1c72bdc req-563d36c5-92fe-4089-acd6-fac8492a28b5 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] No waiting events found dispatching network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:40 user nova-compute[76049]: WARNING nova.compute.manager [req-4e09e246-6711-433d-84f0-f31fb1c72bdc req-563d36c5-92fe-4089-acd6-fac8492a28b5 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received unexpected event network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 for instance with vm_state building and task_state spawning.
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:13:40 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Instance spawned successfully.
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Successfully updated port: 91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquired lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-changed-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Refreshing instance network info cache due to event network-changed-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] Acquiring lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:13:40 user nova-compute[76049]: INFO nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:13:40 user nova-compute[76049]: INFO nova.compute.manager [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Took 7.05 seconds to build instance.
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fab161d8-058f-40a0-9eec-078059ad3bf5 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "25c772f6-5656-46b5-9461-d720314b29ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.182s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Updating instance_info_cache with network_info: [{"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Releasing lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Instance network_info: |[{"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] Acquired lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Refreshing network info cache for port 91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Start _get_guest_xml network_info=[{"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:13:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1768813040',display_name='tempest-TestVolumeSwap-server-1768813040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1768813040',id=18,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEQi5eJ+aoG28vXCbUreMXzDZrV6VSTKkdnKGqj+80uCVQ/9viU/584oNZK6rSiOIBSRfVIdTq/reuZFirht9weW4wUYJisMmCb+aXLGxeieBdrkg92/6jnFaOdzXjlXg==',key_name='tempest-keypair-1506725087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='797846ae50ef4815be5175b94f6fc15b',ramdisk_id='',reservation_id='r-dn0lo4kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-264487762',owner_user_name='tempest-TestVolumeSwap-264487762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='795aee66df224136815061e47764558b',uuid=a127ec44-88e9-4c54-9f41-4e2b8e9f9700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Converting VIF {"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:ed:04,bridge_name='br-int',has_traffic_filtering=True,id=91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b,network=Network(bd5ed087-3bed-4f9b-9f63-b5953030df1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f3f3a5-d4') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lazy-loading 'pci_devices' on Instance uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:13:40 user nova-compute[76049]:   <uuid>a127ec44-88e9-4c54-9f41-4e2b8e9f9700</uuid>
Nov 15 11:13:40 user nova-compute[76049]:   <name>instance-00000012</name>
Nov 15 11:13:40 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:13:40 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:13:40 user nova-compute[76049]:   <metadata>
Nov 15 11:13:40 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:13:40 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:13:40 user nova-compute[76049]:       <nova:name>tempest-TestVolumeSwap-server-1768813040</nova:name>
Nov 15 11:13:40 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:13:40</nova:creationTime>
Nov 15 11:13:40 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:13:40 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:13:40 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:13:40 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:13:40 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:13:40 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:13:40 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:13:40 user nova-compute[76049]:       <nova:owner>
Nov 15 11:13:40 user nova-compute[76049]:         <nova:user uuid="795aee66df224136815061e47764558b">tempest-TestVolumeSwap-264487762-project-member</nova:user>
Nov 15 11:13:40 user nova-compute[76049]:         <nova:project uuid="797846ae50ef4815be5175b94f6fc15b">tempest-TestVolumeSwap-264487762</nova:project>
Nov 15 11:13:40 user nova-compute[76049]:       </nova:owner>
Nov 15 11:13:40 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:13:40 user nova-compute[76049]:       <nova:ports>
Nov 15 11:13:40 user nova-compute[76049]:         <nova:port uuid="91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b">
Nov 15 11:13:40 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 11:13:40 user nova-compute[76049]:         </nova:port>
Nov 15 11:13:40 user nova-compute[76049]:       </nova:ports>
Nov 15 11:13:40 user nova-compute[76049]:     </nova:instance>
Nov 15 11:13:40 user nova-compute[76049]:   </metadata>
Nov 15 11:13:40 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:13:40 user nova-compute[76049]:     <system>
Nov 15 11:13:40 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:13:40 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:13:40 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:13:40 user nova-compute[76049]:       <entry name="serial">a127ec44-88e9-4c54-9f41-4e2b8e9f9700</entry>
Nov 15 11:13:40 user nova-compute[76049]:       <entry name="uuid">a127ec44-88e9-4c54-9f41-4e2b8e9f9700</entry>
Nov 15 11:13:40 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:13:40 user nova-compute[76049]:     </system>
Nov 15 11:13:40 user nova-compute[76049]:   </sysinfo>
Nov 15 11:13:40 user nova-compute[76049]:   <os>
Nov 15 11:13:40 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:13:40 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:13:40 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:13:40 user nova-compute[76049]:   </os>
Nov 15 11:13:40 user nova-compute[76049]:   <features>
Nov 15 11:13:40 user nova-compute[76049]:     <acpi/>
Nov 15 11:13:40 user nova-compute[76049]:     <apic/>
Nov 15 11:13:40 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:13:40 user nova-compute[76049]:   </features>
Nov 15 11:13:40 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:13:40 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:13:40 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:13:40 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:13:40 user nova-compute[76049]:   </clock>
Nov 15 11:13:40 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:13:40 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:13:40 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:13:40 user nova-compute[76049]:   </cpu>
Nov 15 11:13:40 user nova-compute[76049]:   <devices>
Nov 15 11:13:40 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:13:40 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:13:40 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk"/>
Nov 15 11:13:40 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:13:40 user nova-compute[76049]:     </disk>
Nov 15 11:13:40 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:13:40 user nova-compute[76049]:       <mac address="fa:16:3e:92:ed:04"/>
Nov 15 11:13:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:40 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:13:40 user nova-compute[76049]:       <target dev="tap91f3f3a5-d4"/>
Nov 15 11:13:40 user nova-compute[76049]:     </interface>
Nov 15 11:13:40 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:13:40 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/console.log" append="off"/>
Nov 15 11:13:40 user nova-compute[76049]:     </serial>
Nov 15 11:13:40 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:13:40 user nova-compute[76049]:     <video>
Nov 15 11:13:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:13:40 user nova-compute[76049]:     </video>
Nov 15 11:13:40 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:13:40 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:13:40 user nova-compute[76049]:     </rng>
Nov 15 11:13:40 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:13:40 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:13:40 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:13:40 user nova-compute[76049]:     </memballoon>
Nov 15 11:13:40 user nova-compute[76049]:   </devices>
Nov 15 11:13:40 user nova-compute[76049]: </domain>
Nov 15 11:13:40 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1768813040',display_name='tempest-TestVolumeSwap-server-1768813040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1768813040',id=18,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEQi5eJ+aoG28vXCbUreMXzDZrV6VSTKkdnKGqj+80uCVQ/9viU/584oNZK6rSiOIBSRfVIdTq/reuZFirht9weW4wUYJisMmCb+aXLGxeieBdrkg92/6jnFaOdzXjlXg==',key_name='tempest-keypair-1506725087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='797846ae50ef4815be5175b94f6fc15b',ramdisk_id='',reservation_id='r-dn0lo4kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-264487762',owner_user_name='tempest-TestVolumeSwap-264487762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='795aee66df224136815061e47764558b',uuid=a127ec44-88e9-4c54-9f41-4e2b8e9f9700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Converting VIF {"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:ed:04,bridge_name='br-int',has_traffic_filtering=True,id=91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b,network=Network(bd5ed087-3bed-4f9b-9f63-b5953030df1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f3f3a5-d4') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG os_vif [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ed:04,bridge_name='br-int',has_traffic_filtering=True,id=91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b,network=Network(bd5ed087-3bed-4f9b-9f63-b5953030df1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f3f3a5-d4') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '168541cd-b2d9-5c7a-9a26-e68c0edf91ad', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91f3f3a5-d4, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91f3f3a5-d4, col_values=(('qos', UUID('1c87df64-702e-4d3c-99e4-67f3e03aa1a6')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91f3f3a5-d4, col_values=(('external_ids', {'iface-id': '91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:ed:04', 'vm-uuid': 'a127ec44-88e9-4c54-9f41-4e2b8e9f9700'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:40 user nova-compute[76049]: INFO os_vif [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ed:04,bridge_name='br-int',has_traffic_filtering=True,id=91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b,network=Network(bd5ed087-3bed-4f9b-9f63-b5953030df1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f3f3a5-d4')
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:13:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] No VIF found with MAC fa:16:3e:92:ed:04, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:13:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Updated VIF entry in instance network info cache for port 91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:13:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Updating instance_info_cache with network_info: [{"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:13:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0286a999-d16b-4836-9abe-533124c2e13c req-28b06e8a-cca1-46ff-815c-0761c438fbed service nova] Releasing lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:13:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-521d548b-7964-43aa-8664-5fbf1bb24537 req-69d64e2f-fb1e-46a4-9193-42d2bed97b7c service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-521d548b-7964-43aa-8664-5fbf1bb24537 req-69d64e2f-fb1e-46a4-9193-42d2bed97b7c service nova] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-521d548b-7964-43aa-8664-5fbf1bb24537 req-69d64e2f-fb1e-46a4-9193-42d2bed97b7c service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-521d548b-7964-43aa-8664-5fbf1bb24537 req-69d64e2f-fb1e-46a4-9193-42d2bed97b7c service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-521d548b-7964-43aa-8664-5fbf1bb24537 req-69d64e2f-fb1e-46a4-9193-42d2bed97b7c service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] No waiting events found dispatching network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:42 user nova-compute[76049]: WARNING nova.compute.manager [req-521d548b-7964-43aa-8664-5fbf1bb24537 req-69d64e2f-fb1e-46a4-9193-42d2bed97b7c service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received unexpected event network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b for instance with vm_state building and task_state spawning.
Nov 15 11:13:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-4d256a31-708b-4b8d-a3a0-14a0b7c0d44f req-2426d9c4-4060-43de-9f95-096143c56e00 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4d256a31-708b-4b8d-a3a0-14a0b7c0d44f req-2426d9c4-4060-43de-9f95-096143c56e00 service nova] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4d256a31-708b-4b8d-a3a0-14a0b7c0d44f req-2426d9c4-4060-43de-9f95-096143c56e00 service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4d256a31-708b-4b8d-a3a0-14a0b7c0d44f req-2426d9c4-4060-43de-9f95-096143c56e00 service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-4d256a31-708b-4b8d-a3a0-14a0b7c0d44f req-2426d9c4-4060-43de-9f95-096143c56e00 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] No waiting events found dispatching network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:13:44 user nova-compute[76049]: WARNING nova.compute.manager [req-4d256a31-708b-4b8d-a3a0-14a0b7c0d44f req-2426d9c4-4060-43de-9f95-096143c56e00 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received unexpected event network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b for instance with vm_state building and task_state spawning.
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:13:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Instance spawned successfully.
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:13:44 user nova-compute[76049]: INFO nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 15 11:13:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:13:44 user nova-compute[76049]: INFO nova.compute.manager [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Took 7.06 seconds to build instance.
Nov 15 11:13:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c0f6d5aa-01e3-4739-9367-e9e59af72342 tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.205s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:13:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:13:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:14:11 user nova-compute[76049]: INFO nova.compute.manager [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] instance snapshotting
Nov 15 11:14:11 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Beginning live snapshot process
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:14:12 user nova-compute[76049]: INFO nova.compute.claims [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Claim successful on node user
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplq6vrmxz/b27bc3652a784c8bb299cb4a113e202d.delta 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplq6vrmxz/b27bc3652a784c8bb299cb4a113e202d.delta 1073741824" returned: 0 in 0.220s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:14:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.policy [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092762011c594cb6b7badf4bbafe513e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df502284cb84433a1ddd5195da15df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:14:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Creating image(s)
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "/opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "/opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.231s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk 1073741824" returned: 0 in 0.060s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG nova.network.neutron [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Successfully created port: 0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] COPY block job progress, current cursor: 16908288 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Cannot resize image /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Ensure instance console log exists: /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] COPY block job progress, current cursor: 75235328 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:14:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Successfully updated port: 0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquired lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-changed-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Refreshing instance network info cache due to event network-changed-0b2a48c8-242b-4d4a-b3ee-7ac418412efd. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] Acquiring lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplq6vrmxz/b27bc3652a784c8bb299cb4a113e202d.delta /opt/stack/data/nova/instances/snapshots/tmplq6vrmxz/b27bc3652a784c8bb299cb4a113e202d {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updating instance_info_cache with network_info: [{"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplq6vrmxz/b27bc3652a784c8bb299cb4a113e202d.delta /opt/stack/data/nova/instances/snapshots/tmplq6vrmxz/b27bc3652a784c8bb299cb4a113e202d" returned: 0 in 0.530s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Snapshot extracted, beginning image upload
Nov 15 11:14:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Releasing lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Instance network_info: |[{"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] Acquired lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Refreshing network info cache for port 0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Start _get_guest_xml network_info=[{"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:14:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1915406476',display_name='tempest-VolumesSnapshotTestJSON-instance-1915406476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1915406476',id=19,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb2VmQc11eWTXjAemB1l4fra2afHkYSJ8K+UMdrj6R/IzNhOTQ4Hlo4P9ZpCFkpxEtSESm6Ag24sfzJn70EY9kNFnOVUrmNJuNznuDp2zA3E/m2ayPwQk8b9THHpjssqQ==',key_name='tempest-keypair-915741938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df502284cb84433a1ddd5195da15df8',ramdisk_id='',reservation_id='r-orplk4hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-753677889',owner_user_name='tempest-VolumesSnapshotTestJSON-753677889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092762011c594cb6b7badf4bbafe513e',uuid=a4313390-b944-4fb4-880f-9868d6932977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converting VIF {"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2a48c8-24') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'pci_devices' on Instance uuid a4313390-b944-4fb4-880f-9868d6932977 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:14:15 user nova-compute[76049]:   <uuid>a4313390-b944-4fb4-880f-9868d6932977</uuid>
Nov 15 11:14:15 user nova-compute[76049]:   <name>instance-00000013</name>
Nov 15 11:14:15 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:14:15 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:14:15 user nova-compute[76049]:   <metadata>
Nov 15 11:14:15 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:14:15 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:14:15 user nova-compute[76049]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1915406476</nova:name>
Nov 15 11:14:15 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:14:15</nova:creationTime>
Nov 15 11:14:15 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:14:15 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:14:15 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:14:15 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:14:15 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:14:15 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:14:15 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:14:15 user nova-compute[76049]:       <nova:owner>
Nov 15 11:14:15 user nova-compute[76049]:         <nova:user uuid="092762011c594cb6b7badf4bbafe513e">tempest-VolumesSnapshotTestJSON-753677889-project-member</nova:user>
Nov 15 11:14:15 user nova-compute[76049]:         <nova:project uuid="3df502284cb84433a1ddd5195da15df8">tempest-VolumesSnapshotTestJSON-753677889</nova:project>
Nov 15 11:14:15 user nova-compute[76049]:       </nova:owner>
Nov 15 11:14:15 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:14:15 user nova-compute[76049]:       <nova:ports>
Nov 15 11:14:15 user nova-compute[76049]:         <nova:port uuid="0b2a48c8-242b-4d4a-b3ee-7ac418412efd">
Nov 15 11:14:15 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 11:14:15 user nova-compute[76049]:         </nova:port>
Nov 15 11:14:15 user nova-compute[76049]:       </nova:ports>
Nov 15 11:14:15 user nova-compute[76049]:     </nova:instance>
Nov 15 11:14:15 user nova-compute[76049]:   </metadata>
Nov 15 11:14:15 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:14:15 user nova-compute[76049]:     <system>
Nov 15 11:14:15 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:14:15 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:14:15 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:14:15 user nova-compute[76049]:       <entry name="serial">a4313390-b944-4fb4-880f-9868d6932977</entry>
Nov 15 11:14:15 user nova-compute[76049]:       <entry name="uuid">a4313390-b944-4fb4-880f-9868d6932977</entry>
Nov 15 11:14:15 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:14:15 user nova-compute[76049]:     </system>
Nov 15 11:14:15 user nova-compute[76049]:   </sysinfo>
Nov 15 11:14:15 user nova-compute[76049]:   <os>
Nov 15 11:14:15 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:14:15 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:14:15 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:14:15 user nova-compute[76049]:   </os>
Nov 15 11:14:15 user nova-compute[76049]:   <features>
Nov 15 11:14:15 user nova-compute[76049]:     <acpi/>
Nov 15 11:14:15 user nova-compute[76049]:     <apic/>
Nov 15 11:14:15 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:14:15 user nova-compute[76049]:   </features>
Nov 15 11:14:15 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:14:15 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:14:15 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:14:15 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:14:15 user nova-compute[76049]:   </clock>
Nov 15 11:14:15 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:14:15 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:14:15 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:14:15 user nova-compute[76049]:   </cpu>
Nov 15 11:14:15 user nova-compute[76049]:   <devices>
Nov 15 11:14:15 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:14:15 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:14:15 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk"/>
Nov 15 11:14:15 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:14:15 user nova-compute[76049]:     </disk>
Nov 15 11:14:15 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:14:15 user nova-compute[76049]:       <mac address="fa:16:3e:1b:ba:bd"/>
Nov 15 11:14:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:15 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:14:15 user nova-compute[76049]:       <target dev="tap0b2a48c8-24"/>
Nov 15 11:14:15 user nova-compute[76049]:     </interface>
Nov 15 11:14:15 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:14:15 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/console.log" append="off"/>
Nov 15 11:14:15 user nova-compute[76049]:     </serial>
Nov 15 11:14:15 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:14:15 user nova-compute[76049]:     <video>
Nov 15 11:14:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:15 user nova-compute[76049]:     </video>
Nov 15 11:14:15 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:14:15 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:14:15 user nova-compute[76049]:     </rng>
Nov 15 11:14:15 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:14:15 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:14:15 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:14:15 user nova-compute[76049]:     </memballoon>
Nov 15 11:14:15 user nova-compute[76049]:   </devices>
Nov 15 11:14:15 user nova-compute[76049]: </domain>
Nov 15 11:14:15 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1915406476',display_name='tempest-VolumesSnapshotTestJSON-instance-1915406476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1915406476',id=19,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb2VmQc11eWTXjAemB1l4fra2afHkYSJ8K+UMdrj6R/IzNhOTQ4Hlo4P9ZpCFkpxEtSESm6Ag24sfzJn70EY9kNFnOVUrmNJuNznuDp2zA3E/m2ayPwQk8b9THHpjssqQ==',key_name='tempest-keypair-915741938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df502284cb84433a1ddd5195da15df8',ramdisk_id='',reservation_id='r-orplk4hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-753677889',owner_user_name='tempest-VolumesSnapshotTestJSON-753677889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092762011c594cb6b7badf4bbafe513e',uuid=a4313390-b944-4fb4-880f-9868d6932977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converting VIF {"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2a48c8-24') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG os_vif [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2a48c8-24') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd113280-2478-55cf-8386-8daa3de87ba4', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b2a48c8-24, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b2a48c8-24, col_values=(('qos', UUID('92e30de6-201d-4e5f-9bce-57914d62b238')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b2a48c8-24, col_values=(('external_ids', {'iface-id': '0b2a48c8-242b-4d4a-b3ee-7ac418412efd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:ba:bd', 'vm-uuid': 'a4313390-b944-4fb4-880f-9868d6932977'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:15 user nova-compute[76049]: INFO os_vif [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2a48c8-24')
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No VIF found with MAC fa:16:3e:1b:ba:bd, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updated VIF entry in instance network info cache for port 0b2a48c8-242b-4d4a-b3ee-7ac418412efd. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updating instance_info_cache with network_info: [{"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c1322283-9147-490b-b0ba-dfca117261a0 req-61cdb95b-c2b8-4ea3-86fa-040545c3b6fb service nova] Releasing lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:17 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:14:17 user nova-compute[76049]: INFO nova.compute.claims [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Claim successful on node user
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:14:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:14:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Snapshot image upload complete
Nov 15 11:14:18 user nova-compute[76049]: INFO nova.compute.manager [None req-e6af5807-da1b-4d9e-8c80-6777d8ae49d3 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Took 7.32 seconds to snapshot the instance on the hypervisor.
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.policy [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8dbaf60d380d45e8844a85b0064ed9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28351c85da4988a1f942d5948be8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:14:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Creating image(s)
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.209s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk 1073741824" returned: 0 in 0.049s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Successfully created port: 5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Cannot resize image /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Ensure instance console log exists: /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:14:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a4313390-b944-4fb4-880f-9868d6932977] Instance spawned successfully.
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:19 user nova-compute[76049]: INFO nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 15 11:14:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:14:19 user nova-compute[76049]: INFO nova.compute.manager [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Took 7.94 seconds to build instance.
Nov 15 11:14:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0cb4834a-c425-4fb8-9de5-fa9daff18bff tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.194s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-3644ff67-3a33-45d2-9f77-b925bde344ab req-56ff6fd6-4877-4d9c-860d-f44f1e6ba7f0 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3644ff67-3a33-45d2-9f77-b925bde344ab req-56ff6fd6-4877-4d9c-860d-f44f1e6ba7f0 service nova] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3644ff67-3a33-45d2-9f77-b925bde344ab req-56ff6fd6-4877-4d9c-860d-f44f1e6ba7f0 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3644ff67-3a33-45d2-9f77-b925bde344ab req-56ff6fd6-4877-4d9c-860d-f44f1e6ba7f0 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-3644ff67-3a33-45d2-9f77-b925bde344ab req-56ff6fd6-4877-4d9c-860d-f44f1e6ba7f0 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] No waiting events found dispatching network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:20 user nova-compute[76049]: WARNING nova.compute.manager [req-3644ff67-3a33-45d2-9f77-b925bde344ab req-56ff6fd6-4877-4d9c-860d-f44f1e6ba7f0 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received unexpected event network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd for instance with vm_state active and task_state None.
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Successfully updated port: 5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing instance network info cache due to event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance network_info: |[{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.neutron [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Start _get_guest_xml network_info=[{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:14:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1539619791',display_name='tempest-ServerStableDeviceRescueTest-server-1539619791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1539619791',id=20,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5YJ6b2hQTaoK1rprHOO7ah8cYXA9w5jrVcvFmaVX8faQX1l0vcPy31SLLQHA4MWR+Rd3TzxheoN+k2VY5atuSZjVgz+xwoPtwSMUOjzv+PcGV1X5IbQVwo3pdCvohqmQ==',key_name='tempest-keypair-62701307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f28351c85da4988a1f942d5948be8c2',ramdisk_id='',reservation_id='r-vi4h98mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1167147547',owner_user_name='tempest-ServerStableDeviceRescueTest-1167147547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dbaf60d380d45e8844a85b0064ed9c3',uuid=00bc4c99-4801-474c-85ad-13534fe75469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converting VIF {"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.objects.instance [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'pci_devices' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:14:21 user nova-compute[76049]:   <uuid>00bc4c99-4801-474c-85ad-13534fe75469</uuid>
Nov 15 11:14:21 user nova-compute[76049]:   <name>instance-00000014</name>
Nov 15 11:14:21 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:14:21 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:14:21 user nova-compute[76049]:   <metadata>
Nov 15 11:14:21 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:14:21 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:14:21 user nova-compute[76049]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1539619791</nova:name>
Nov 15 11:14:21 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:14:21</nova:creationTime>
Nov 15 11:14:21 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:14:21 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:14:21 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:14:21 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:14:21 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:14:21 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:14:21 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:14:21 user nova-compute[76049]:       <nova:owner>
Nov 15 11:14:21 user nova-compute[76049]:         <nova:user uuid="8dbaf60d380d45e8844a85b0064ed9c3">tempest-ServerStableDeviceRescueTest-1167147547-project-member</nova:user>
Nov 15 11:14:21 user nova-compute[76049]:         <nova:project uuid="8f28351c85da4988a1f942d5948be8c2">tempest-ServerStableDeviceRescueTest-1167147547</nova:project>
Nov 15 11:14:21 user nova-compute[76049]:       </nova:owner>
Nov 15 11:14:21 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:14:21 user nova-compute[76049]:       <nova:ports>
Nov 15 11:14:21 user nova-compute[76049]:         <nova:port uuid="5a1e963d-d9f8-4923-8b9e-19a1027bba51">
Nov 15 11:14:21 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:14:21 user nova-compute[76049]:         </nova:port>
Nov 15 11:14:21 user nova-compute[76049]:       </nova:ports>
Nov 15 11:14:21 user nova-compute[76049]:     </nova:instance>
Nov 15 11:14:21 user nova-compute[76049]:   </metadata>
Nov 15 11:14:21 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:14:21 user nova-compute[76049]:     <system>
Nov 15 11:14:21 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:14:21 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:14:21 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:14:21 user nova-compute[76049]:       <entry name="serial">00bc4c99-4801-474c-85ad-13534fe75469</entry>
Nov 15 11:14:21 user nova-compute[76049]:       <entry name="uuid">00bc4c99-4801-474c-85ad-13534fe75469</entry>
Nov 15 11:14:21 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:14:21 user nova-compute[76049]:     </system>
Nov 15 11:14:21 user nova-compute[76049]:   </sysinfo>
Nov 15 11:14:21 user nova-compute[76049]:   <os>
Nov 15 11:14:21 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:14:21 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:14:21 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:14:21 user nova-compute[76049]:   </os>
Nov 15 11:14:21 user nova-compute[76049]:   <features>
Nov 15 11:14:21 user nova-compute[76049]:     <acpi/>
Nov 15 11:14:21 user nova-compute[76049]:     <apic/>
Nov 15 11:14:21 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:14:21 user nova-compute[76049]:   </features>
Nov 15 11:14:21 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:14:21 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:14:21 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:14:21 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:14:21 user nova-compute[76049]:   </clock>
Nov 15 11:14:21 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:14:21 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:14:21 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:14:21 user nova-compute[76049]:   </cpu>
Nov 15 11:14:21 user nova-compute[76049]:   <devices>
Nov 15 11:14:21 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:14:21 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:14:21 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk"/>
Nov 15 11:14:21 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:14:21 user nova-compute[76049]:     </disk>
Nov 15 11:14:21 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:14:21 user nova-compute[76049]:       <mac address="fa:16:3e:f4:ca:26"/>
Nov 15 11:14:21 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:21 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:14:21 user nova-compute[76049]:       <target dev="tap5a1e963d-d9"/>
Nov 15 11:14:21 user nova-compute[76049]:     </interface>
Nov 15 11:14:21 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:14:21 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/console.log" append="off"/>
Nov 15 11:14:21 user nova-compute[76049]:     </serial>
Nov 15 11:14:21 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:14:21 user nova-compute[76049]:     <video>
Nov 15 11:14:21 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:21 user nova-compute[76049]:     </video>
Nov 15 11:14:21 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:14:21 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:14:21 user nova-compute[76049]:     </rng>
Nov 15 11:14:21 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:14:21 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:14:21 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:14:21 user nova-compute[76049]:     </memballoon>
Nov 15 11:14:21 user nova-compute[76049]:   </devices>
Nov 15 11:14:21 user nova-compute[76049]: </domain>
Nov 15 11:14:21 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1539619791',display_name='tempest-ServerStableDeviceRescueTest-server-1539619791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1539619791',id=20,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5YJ6b2hQTaoK1rprHOO7ah8cYXA9w5jrVcvFmaVX8faQX1l0vcPy31SLLQHA4MWR+Rd3TzxheoN+k2VY5atuSZjVgz+xwoPtwSMUOjzv+PcGV1X5IbQVwo3pdCvohqmQ==',key_name='tempest-keypair-62701307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f28351c85da4988a1f942d5948be8c2',ramdisk_id='',reservation_id='r-vi4h98mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1167147547',owner_user_name='tempest-ServerStableDeviceRescueTest-1167147547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dbaf60d380d45e8844a85b0064ed9c3',uuid=00bc4c99-4801-474c-85ad-13534fe75469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converting VIF {"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG os_vif [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c368fbb4-477b-5d03-82aa-a4c0834dcc3b', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a1e963d-d9, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a1e963d-d9, col_values=(('qos', UUID('431d0bef-6450-47c7-b34a-de5f10aff4c4')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a1e963d-d9, col_values=(('external_ids', {'iface-id': '5a1e963d-d9f8-4923-8b9e-19a1027bba51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ca:26', 'vm-uuid': '00bc4c99-4801-474c-85ad-13534fe75469'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:22 user nova-compute[76049]: INFO os_vif [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9')
Nov 15 11:14:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:14:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No VIF found with MAC fa:16:3e:f4:ca:26, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updated VIF entry in instance network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3fc5d5cf-54f8-4c4a-b871-452c75b554fe req-43a56b9a-9a4c-475f-abd2-70c92f89b010 service nova] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-a1439241-6eb5-474e-bafa-3880ef80044a req-24437162-1a03-438a-b2a2-e33525ca8691 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a1439241-6eb5-474e-bafa-3880ef80044a req-24437162-1a03-438a-b2a2-e33525ca8691 service nova] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a1439241-6eb5-474e-bafa-3880ef80044a req-24437162-1a03-438a-b2a2-e33525ca8691 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a1439241-6eb5-474e-bafa-3880ef80044a req-24437162-1a03-438a-b2a2-e33525ca8691 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-a1439241-6eb5-474e-bafa-3880ef80044a req-24437162-1a03-438a-b2a2-e33525ca8691 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] No waiting events found dispatching network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:23 user nova-compute[76049]: WARNING nova.compute.manager [req-a1439241-6eb5-474e-bafa-3880ef80044a req-24437162-1a03-438a-b2a2-e33525ca8691 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received unexpected event network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd for instance with vm_state active and task_state None.
Nov 15 11:14:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:14:24 user nova-compute[76049]: INFO nova.compute.claims [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Claim successful on node user
Nov 15 11:14:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-5b9ce1ef-8383-4317-92c6-dd0ef262673b req-64fb2ffa-8a73-43e0-80db-ce8e93106fc1 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5b9ce1ef-8383-4317-92c6-dd0ef262673b req-64fb2ffa-8a73-43e0-80db-ce8e93106fc1 service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5b9ce1ef-8383-4317-92c6-dd0ef262673b req-64fb2ffa-8a73-43e0-80db-ce8e93106fc1 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5b9ce1ef-8383-4317-92c6-dd0ef262673b req-64fb2ffa-8a73-43e0-80db-ce8e93106fc1 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-5b9ce1ef-8383-4317-92c6-dd0ef262673b req-64fb2ffa-8a73-43e0-80db-ce8e93106fc1 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:24 user nova-compute[76049]: WARNING nova.compute.manager [req-5b9ce1ef-8383-4317-92c6-dd0ef262673b req-64fb2ffa-8a73-43e0-80db-ce8e93106fc1 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state building and task_state spawning.
Nov 15 11:14:24 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:14:24 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:14:25 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.policy [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '842ce026504c47a993bbda489c8385a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517681dc6ca4788a7ae3e969a9831cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:14:25 user nova-compute[76049]: INFO nova.virt.block_device [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Booting with volume 13e25910-8dea-43b7-8b04-bb6b6420ecd3 at /dev/vda
Nov 15 11:14:25 user nova-compute[76049]: DEBUG os_brick.utils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70cc788-7e04-4cb4-b11f-4a9c33327c63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c70d0-f8ee-4958-affa-a94d2f17b740]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f10a600-508c-4e6e-9f98-15803def426e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a2d7d-d521-4437-8ab8-4773e5f017f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:14:25 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c0fe1-7fa1-4c27-9e74-0b16b97926fd]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG os_brick.utils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating existing volume attachment record: b8d0e2cd-5261-44b1-8ad4-0bb379177142 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:14:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Successfully created port: 53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Successfully updated port: 53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:14:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance spawned successfully.
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-changed-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing instance network info cache due to event network-changed-53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-fa0f806a-ae29-4d12-bc06-2c0e02fd737c req-6bf6c83c-776f-4be6-b18a-25dd852d2b5d service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fa0f806a-ae29-4d12-bc06-2c0e02fd737c req-6bf6c83c-776f-4be6-b18a-25dd852d2b5d service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fa0f806a-ae29-4d12-bc06-2c0e02fd737c req-6bf6c83c-776f-4be6-b18a-25dd852d2b5d service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fa0f806a-ae29-4d12-bc06-2c0e02fd737c req-6bf6c83c-776f-4be6-b18a-25dd852d2b5d service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-fa0f806a-ae29-4d12-bc06-2c0e02fd737c req-6bf6c83c-776f-4be6-b18a-25dd852d2b5d service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:26 user nova-compute[76049]: WARNING nova.compute.manager [req-fa0f806a-ae29-4d12-bc06-2c0e02fd737c req-6bf6c83c-776f-4be6-b18a-25dd852d2b5d service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state building and task_state spawning.
Nov 15 11:14:26 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:14:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:27 user nova-compute[76049]: INFO nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Took 8.37 seconds to spawn the instance on the hypervisor.
Nov 15 11:14:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:27 user nova-compute[76049]: INFO nova.compute.manager [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Took 9.29 seconds to build instance.
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-10b99b35-2d24-452d-b32a-6e9e679d250d tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.458s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance network_info: |[{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "e5b4194d-37cb-47f2-96a1-efe798985010" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "e5b4194d-37cb-47f2-96a1-efe798985010" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG nova.network.neutron [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing network info cache for port 53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:14:27 user nova-compute[76049]: INFO nova.compute.manager [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Terminating instance
Nov 15 11:14:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.348s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.network.neutron [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updated VIF entry in instance network info cache for port 53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.network.neutron [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-12478b92-ee80-48de-886b-94204dab66c5 req-80a686e9-29e4-4f67-83dc-c11a67127514 service nova] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Instance destroyed successfully.
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lazy-loading 'resources' on Instance uuid e5b4194d-37cb-47f2-96a1-efe798985010 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1215641488',display_name='tempest-VolumesAdminNegativeTest-server-1215641488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1215641488',id=14,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:12:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b1b6dce9c3847f1be9a07015b683421',ramdisk_id='',reservation_id='r-rx8tymbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-448739573',owner_user_name='tempest-VolumesAdminNegativeTest-448739573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:12:37Z,user_data=None,user_id='543673d5b4f241df830806894717043f',uuid=e5b4194d-37cb-47f2-96a1-efe798985010,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converting VIF {"id": "a17053b8-25d4-4d35-acee-69ecaae13440", "address": "fa:16:3e:59:6a:d6", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17053b8-25", "ovs_interfaceid": "a17053b8-25d4-4d35-acee-69ecaae13440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:6a:d6,bridge_name='br-int',has_traffic_filtering=True,id=a17053b8-25d4-4d35-acee-69ecaae13440,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17053b8-25') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG os_vif [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6a:d6,bridge_name='br-int',has_traffic_filtering=True,id=a17053b8-25d4-4d35-acee-69ecaae13440,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17053b8-25') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa17053b8-25, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79c45dd4-dbb0-4145-bbde-23644aa59aab) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:28 user nova-compute[76049]: INFO os_vif [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6a:d6,bridge_name='br-int',has_traffic_filtering=True,id=a17053b8-25d4-4d35-acee-69ecaae13440,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17053b8-25')
Nov 15 11:14:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Deleting instance files /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010_del
Nov 15 11:14:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Deletion of /opt/stack/data/nova/instances/e5b4194d-37cb-47f2-96a1-efe798985010_del complete
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:28 user nova-compute[76049]: INFO nova.compute.manager [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received event network-vif-unplugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] Acquiring lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] No waiting events found dispatching network-vif-unplugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received event network-vif-unplugged-a17053b8-25d4-4d35-acee-69ecaae13440 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received event network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] Acquiring lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] Lock "e5b4194d-37cb-47f2-96a1-efe798985010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] No waiting events found dispatching network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:28 user nova-compute[76049]: WARNING nova.compute.manager [req-bb48f274-8c42-4ac9-8ee4-0b72f2a05b24 req-686304f1-ef31-4f28-986f-20bb3af808d4 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received unexpected event network-vif-plugged-a17053b8-25d4-4d35-acee-69ecaae13440 for instance with vm_state active and task_state deleting.
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-16cb85f4-34aa-439b-92ba-4e234a614cef req-50d700a1-b7e8-45e9-8c6c-2fbddd70ff01 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Received event network-vif-deleted-a17053b8-25d4-4d35-acee-69ecaae13440 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:29 user nova-compute[76049]: INFO nova.compute.manager [req-16cb85f4-34aa-439b-92ba-4e234a614cef req-50d700a1-b7e8-45e9-8c6c-2fbddd70ff01 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Neutron deleted interface a17053b8-25d4-4d35-acee-69ecaae13440; detaching it from the instance and deleting it from the info cache
Nov 15 11:14:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-16cb85f4-34aa-439b-92ba-4e234a614cef req-50d700a1-b7e8-45e9-8c6c-2fbddd70ff01 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:29 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Took 0.75 seconds to deallocate network for instance.
Nov 15 11:14:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-16cb85f4-34aa-439b-92ba-4e234a614cef req-50d700a1-b7e8-45e9-8c6c-2fbddd70ff01 service nova] [instance: e5b4194d-37cb-47f2-96a1-efe798985010] Detach interface failed, port_id=a17053b8-25d4-4d35-acee-69ecaae13440, reason: Instance e5b4194d-37cb-47f2-96a1-efe798985010 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:30 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:14:30 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:14:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.134s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc/disk --force-share --output=json" returned: 0 in 0.699s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:30 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid 'e5b4194d-37cb-47f2-96a1-efe798985010' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e5b4194d-37cb-47f2-96a1-efe798985010' (instance-0000000e)
Nov 15 11:14:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:30 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Deleted allocations for instance e5b4194d-37cb-47f2-96a1-efe798985010
Nov 15 11:14:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-70aca8b3-5aa4-426b-a2f1-742c95b1d722 tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "e5b4194d-37cb-47f2-96a1-efe798985010" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.445s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7473MB free_disk=25.471080780029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance cc582aae-00f7-4c3d-b551-a70aac92d7ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 2e94785d-54bf-499f-a06c-9b96ff7717bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance e85673b8-ef01-4635-9b47-c4935778dba4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d23b5032-89df-47d6-93fa-496bd3d5671c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a4313390-b944-4fb4-880f-9868d6932977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 00bc4c99-4801-474c-85ad-13534fe75469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 692c3208-4d15-4aa6-beca-87a1d2a01e40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:14:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:14:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Creating image(s)
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Ensure instance console log exists: /opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Start _get_guest_xml network_info=[{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '692c3208-4d15-4aa6-beca-87a1d2a01e40', 'attached_at': '', 'detached_at': '', 'volume_id': '13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'serial': '13e25910-8dea-43b7-8b04-bb6b6420ecd3'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'b8d0e2cd-5261-44b1-8ad4-0bb379177142', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:14:32 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:32 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:14:32 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:14:32 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:14:32 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[98412193-ce70-4ec6-a2a4-5b940522e6b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:14:32 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd30829-f8fe-4719-a3c0-9a86f8027160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3] added
Nov 15 11:14:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8453b49c-43de-4865-8ec0-e9414812dc58]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.728s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[013cc8ed-f707-4364-8f85-bf9a2fbc1d87]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XweUJdoR {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XweUJdoR" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb0284-c090-4201-ab34-0105ac94ac97]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XweUJdoR'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93cc485-53b7-42ee-a1e9-c055634f9f19]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[179ede89-a553-4bfc-ae01-0b9b09f61cc3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:14:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:14:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[23086fe3-3a64-42ca-a50c-953a657f6a3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]
Nov 15 11:14:32 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.
Nov 15 11:14:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a6064-00e6-4c52-8980-85593f21c677]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae70b2a-08c9-4933-85a6-425bb43a5843]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:14:32 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:14:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:14:32 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:14:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527509b-d150-42c8-82a9-1f9eccc2b462]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:14:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26333633434393535', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333633434393535', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-408780271',display_name='tempest-TestShelveInstance-server-408780271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-408780271',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYCuXNCW/4pVjnhoKADFMrGImq6QQkGiaZ7uvbMBH77mDZowtoehfvC+we1wSh6a66bnUekMn5ts30TyXU+UiDc1BPZm5qH6ffvw8z9cxtBpzcRLa6D3oeFs0U4ypkfxQ==',key_name='tempest-TestShelveInstance-236142358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6517681dc6ca4788a7ae3e969a9831cc',ramdisk_id='',reservation_id='r-2kbv4mks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-289836315',owner_user_name='tempest-TestShelveInstance-289836315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:25Z,user_data=None,user_id='842ce026504c47a993bbda489c8385a4',uuid=692c3208-4d15-4aa6-beca-87a1d2a01e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converting VIF {"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'pci_devices' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:14:33 user nova-compute[76049]:   <uuid>692c3208-4d15-4aa6-beca-87a1d2a01e40</uuid>
Nov 15 11:14:33 user nova-compute[76049]:   <name>instance-00000015</name>
Nov 15 11:14:33 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:14:33 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:14:33 user nova-compute[76049]:   <metadata>
Nov 15 11:14:33 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:14:33 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:14:33 user nova-compute[76049]:       <nova:name>tempest-TestShelveInstance-server-408780271</nova:name>
Nov 15 11:14:33 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:14:32</nova:creationTime>
Nov 15 11:14:33 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:14:33 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:14:33 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:14:33 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:14:33 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:14:33 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:14:33 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:14:33 user nova-compute[76049]:       <nova:owner>
Nov 15 11:14:33 user nova-compute[76049]:         <nova:user uuid="842ce026504c47a993bbda489c8385a4">tempest-TestShelveInstance-289836315-project-member</nova:user>
Nov 15 11:14:33 user nova-compute[76049]:         <nova:project uuid="6517681dc6ca4788a7ae3e969a9831cc">tempest-TestShelveInstance-289836315</nova:project>
Nov 15 11:14:33 user nova-compute[76049]:       </nova:owner>
Nov 15 11:14:33 user nova-compute[76049]:       <nova:ports>
Nov 15 11:14:33 user nova-compute[76049]:         <nova:port uuid="53fecff6-a026-446e-95ff-97b67e493503">
Nov 15 11:14:33 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 11:14:33 user nova-compute[76049]:         </nova:port>
Nov 15 11:14:33 user nova-compute[76049]:       </nova:ports>
Nov 15 11:14:33 user nova-compute[76049]:     </nova:instance>
Nov 15 11:14:33 user nova-compute[76049]:   </metadata>
Nov 15 11:14:33 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:14:33 user nova-compute[76049]:     <system>
Nov 15 11:14:33 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:14:33 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:14:33 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:14:33 user nova-compute[76049]:       <entry name="serial">692c3208-4d15-4aa6-beca-87a1d2a01e40</entry>
Nov 15 11:14:33 user nova-compute[76049]:       <entry name="uuid">692c3208-4d15-4aa6-beca-87a1d2a01e40</entry>
Nov 15 11:14:33 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:14:33 user nova-compute[76049]:     </system>
Nov 15 11:14:33 user nova-compute[76049]:   </sysinfo>
Nov 15 11:14:33 user nova-compute[76049]:   <os>
Nov 15 11:14:33 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:14:33 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:14:33 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:14:33 user nova-compute[76049]:   </os>
Nov 15 11:14:33 user nova-compute[76049]:   <features>
Nov 15 11:14:33 user nova-compute[76049]:     <acpi/>
Nov 15 11:14:33 user nova-compute[76049]:     <apic/>
Nov 15 11:14:33 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:14:33 user nova-compute[76049]:   </features>
Nov 15 11:14:33 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:14:33 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:14:33 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:14:33 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:14:33 user nova-compute[76049]:   </clock>
Nov 15 11:14:33 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:14:33 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:14:33 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:14:33 user nova-compute[76049]:   </cpu>
Nov 15 11:14:33 user nova-compute[76049]:   <devices>
Nov 15 11:14:33 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:14:33 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:14:33 user nova-compute[76049]:       <source dev="/dev/sdb"/>
Nov 15 11:14:33 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:14:33 user nova-compute[76049]:       <serial>13e25910-8dea-43b7-8b04-bb6b6420ecd3</serial>
Nov 15 11:14:33 user nova-compute[76049]:     </disk>
Nov 15 11:14:33 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:14:33 user nova-compute[76049]:       <mac address="fa:16:3e:a9:b6:b6"/>
Nov 15 11:14:33 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:33 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:14:33 user nova-compute[76049]:       <target dev="tap53fecff6-a0"/>
Nov 15 11:14:33 user nova-compute[76049]:     </interface>
Nov 15 11:14:33 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:14:33 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40/console.log" append="off"/>
Nov 15 11:14:33 user nova-compute[76049]:     </serial>
Nov 15 11:14:33 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:14:33 user nova-compute[76049]:     <video>
Nov 15 11:14:33 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:33 user nova-compute[76049]:     </video>
Nov 15 11:14:33 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:14:33 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:14:33 user nova-compute[76049]:     </rng>
Nov 15 11:14:33 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:14:33 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:14:33 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:14:33 user nova-compute[76049]:     </memballoon>
Nov 15 11:14:33 user nova-compute[76049]:   </devices>
Nov 15 11:14:33 user nova-compute[76049]: </domain>
Nov 15 11:14:33 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-408780271',display_name='tempest-TestShelveInstance-server-408780271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-408780271',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYCuXNCW/4pVjnhoKADFMrGImq6QQkGiaZ7uvbMBH77mDZowtoehfvC+we1wSh6a66bnUekMn5ts30TyXU+UiDc1BPZm5qH6ffvw8z9cxtBpzcRLa6D3oeFs0U4ypkfxQ==',key_name='tempest-TestShelveInstance-236142358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6517681dc6ca4788a7ae3e969a9831cc',ramdisk_id='',reservation_id='r-2kbv4mks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-289836315',owner_user_name='tempest-TestShelveInstance-289836315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:25Z,user_data=None,user_id='842ce026504c47a993bbda489c8385a4',uuid=692c3208-4d15-4aa6-beca-87a1d2a01e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converting VIF {"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG os_vif [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3bb80fe-e3e2-56dd-a34a-fc515a5f3aee', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53fecff6-a0, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53fecff6-a0, col_values=(('qos', UUID('94e06268-57c3-4f74-ad33-30568c4a662c')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53fecff6-a0, col_values=(('external_ids', {'iface-id': '53fecff6-a026-446e-95ff-97b67e493503', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:b6:b6', 'vm-uuid': '692c3208-4d15-4aa6-beca-87a1d2a01e40'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:33 user nova-compute[76049]: INFO os_vif [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0')
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:14:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] No VIF found with MAC fa:16:3e:a9:b6:b6, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-866b00a2-ef88-4c32-a467-ae840f876439 req-ed705574-eec0-4e4b-b75e-79b29aa7aec6 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-866b00a2-ef88-4c32-a467-ae840f876439 req-ed705574-eec0-4e4b-b75e-79b29aa7aec6 service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-866b00a2-ef88-4c32-a467-ae840f876439 req-ed705574-eec0-4e4b-b75e-79b29aa7aec6 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-866b00a2-ef88-4c32-a467-ae840f876439 req-ed705574-eec0-4e4b-b75e-79b29aa7aec6 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-866b00a2-ef88-4c32-a467-ae840f876439 req-ed705574-eec0-4e4b-b75e-79b29aa7aec6 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:35 user nova-compute[76049]: WARNING nova.compute.manager [req-866b00a2-ef88-4c32-a467-ae840f876439 req-ed705574-eec0-4e4b-b75e-79b29aa7aec6 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received unexpected event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with vm_state building and task_state spawning.
Nov 15 11:14:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:14:36 user nova-compute[76049]: INFO nova.compute.claims [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Claim successful on node user
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.network.neutron [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:14:36 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.policy [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aab3b8846d7649a78b8f0be07f51945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66e129b2747494fb8fa7cb798b7dc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:14:36 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Creating image(s)
Nov 15 11:14:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.208s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk 1073741824" returned: 0 in 0.056s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebc85650-54f7-46db-8170-46fb8eea0ce8 req-5d4bff73-7051-4ace-a735-fc6484f2c8cc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebc85650-54f7-46db-8170-46fb8eea0ce8 req-5d4bff73-7051-4ace-a735-fc6484f2c8cc service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebc85650-54f7-46db-8170-46fb8eea0ce8 req-5d4bff73-7051-4ace-a735-fc6484f2c8cc service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebc85650-54f7-46db-8170-46fb8eea0ce8 req-5d4bff73-7051-4ace-a735-fc6484f2c8cc service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebc85650-54f7-46db-8170-46fb8eea0ce8 req-5d4bff73-7051-4ace-a735-fc6484f2c8cc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:37 user nova-compute[76049]: WARNING nova.compute.manager [req-ebc85650-54f7-46db-8170-46fb8eea0ce8 req-5d4bff73-7051-4ace-a735-fc6484f2c8cc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received unexpected event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with vm_state building and task_state spawning.
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.network.neutron [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Successfully created port: 5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:14:37 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance spawned successfully.
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:37 user nova-compute[76049]: INFO nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Cannot resize image /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Ensure instance console log exists: /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:37 user nova-compute[76049]: INFO nova.compute.manager [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Took 13.58 seconds to build instance.
Nov 15 11:14:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e35bcd3c-fce5-4130-8f5e-761c31db22f5 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.694s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Successfully updated port: 5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquired lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Releasing lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance network_info: |[{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Start _get_guest_xml network_info=[{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:14:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:38 user nova-compute[76049]: DEBUG nova.objects.instance [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'pci_devices' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:14:39 user nova-compute[76049]:   <uuid>125d7724-a310-49e5-9117-3c6a0527b117</uuid>
Nov 15 11:14:39 user nova-compute[76049]:   <name>instance-00000016</name>
Nov 15 11:14:39 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:14:39 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:14:39 user nova-compute[76049]:   <metadata>
Nov 15 11:14:39 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:14:39 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:14:39 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeTestJSON-server-533537040</nova:name>
Nov 15 11:14:39 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:14:38</nova:creationTime>
Nov 15 11:14:39 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:14:39 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:14:39 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:14:39 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:14:39 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:14:39 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:14:39 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:14:39 user nova-compute[76049]:       <nova:owner>
Nov 15 11:14:39 user nova-compute[76049]:         <nova:user uuid="aab3b8846d7649a78b8f0be07f51945e">tempest-AttachVolumeTestJSON-401613630-project-member</nova:user>
Nov 15 11:14:39 user nova-compute[76049]:         <nova:project uuid="b66e129b2747494fb8fa7cb798b7dc3c">tempest-AttachVolumeTestJSON-401613630</nova:project>
Nov 15 11:14:39 user nova-compute[76049]:       </nova:owner>
Nov 15 11:14:39 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:14:39 user nova-compute[76049]:       <nova:ports>
Nov 15 11:14:39 user nova-compute[76049]:         <nova:port uuid="5ba8d621-889a-4c32-889b-d0cd4adf2472">
Nov 15 11:14:39 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:14:39 user nova-compute[76049]:         </nova:port>
Nov 15 11:14:39 user nova-compute[76049]:       </nova:ports>
Nov 15 11:14:39 user nova-compute[76049]:     </nova:instance>
Nov 15 11:14:39 user nova-compute[76049]:   </metadata>
Nov 15 11:14:39 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:14:39 user nova-compute[76049]:     <system>
Nov 15 11:14:39 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:14:39 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:14:39 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:14:39 user nova-compute[76049]:       <entry name="serial">125d7724-a310-49e5-9117-3c6a0527b117</entry>
Nov 15 11:14:39 user nova-compute[76049]:       <entry name="uuid">125d7724-a310-49e5-9117-3c6a0527b117</entry>
Nov 15 11:14:39 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:14:39 user nova-compute[76049]:     </system>
Nov 15 11:14:39 user nova-compute[76049]:   </sysinfo>
Nov 15 11:14:39 user nova-compute[76049]:   <os>
Nov 15 11:14:39 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:14:39 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:14:39 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:14:39 user nova-compute[76049]:   </os>
Nov 15 11:14:39 user nova-compute[76049]:   <features>
Nov 15 11:14:39 user nova-compute[76049]:     <acpi/>
Nov 15 11:14:39 user nova-compute[76049]:     <apic/>
Nov 15 11:14:39 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:14:39 user nova-compute[76049]:   </features>
Nov 15 11:14:39 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:14:39 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:14:39 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:14:39 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:14:39 user nova-compute[76049]:   </clock>
Nov 15 11:14:39 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:14:39 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:14:39 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:14:39 user nova-compute[76049]:   </cpu>
Nov 15 11:14:39 user nova-compute[76049]:   <devices>
Nov 15 11:14:39 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:14:39 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:14:39 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk"/>
Nov 15 11:14:39 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:14:39 user nova-compute[76049]:     </disk>
Nov 15 11:14:39 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:14:39 user nova-compute[76049]:       <mac address="fa:16:3e:79:34:99"/>
Nov 15 11:14:39 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:39 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:14:39 user nova-compute[76049]:       <target dev="tap5ba8d621-88"/>
Nov 15 11:14:39 user nova-compute[76049]:     </interface>
Nov 15 11:14:39 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:14:39 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/console.log" append="off"/>
Nov 15 11:14:39 user nova-compute[76049]:     </serial>
Nov 15 11:14:39 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:14:39 user nova-compute[76049]:     <video>
Nov 15 11:14:39 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:14:39 user nova-compute[76049]:     </video>
Nov 15 11:14:39 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:14:39 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:14:39 user nova-compute[76049]:     </rng>
Nov 15 11:14:39 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:14:39 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:14:39 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:14:39 user nova-compute[76049]:     </memballoon>
Nov 15 11:14:39 user nova-compute[76049]:   </devices>
Nov 15 11:14:39 user nova-compute[76049]: </domain>
Nov 15 11:14:39 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG os_vif [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f6d92c5-a809-5a71-8a74-fe514389e03c', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ba8d621-88, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ba8d621-88, col_values=(('qos', UUID('bdd05101-6b3f-4621-97ec-eacf1df548db')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ba8d621-88, col_values=(('external_ids', {'iface-id': '5ba8d621-889a-4c32-889b-d0cd4adf2472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:34:99', 'vm-uuid': '125d7724-a310-49e5-9117-3c6a0527b117'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:39 user nova-compute[76049]: INFO os_vif [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88')
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No VIF found with MAC fa:16:3e:79:34:99, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-changed-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Refreshing instance network info cache due to event network-changed-5ba8d621-889a-4c32-889b-d0cd4adf2472. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] Acquiring lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] Acquired lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.network.neutron [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Refreshing network info cache for port 5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.network.neutron [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updated VIF entry in instance network info cache for port 5ba8d621-889a-4c32-889b-d0cd4adf2472. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:14:39 user nova-compute[76049]: DEBUG nova.network.neutron [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd40f428-8335-4e6d-91d9-5f6c3b4c5207 req-056fd13a-44a5-4adb-bf6c-be17ae6d8af6 service nova] Releasing lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-069da92f-7399-40e2-8dad-8e0950da0496 req-7e19d733-90e0-487f-b417-fef980fce4e6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-069da92f-7399-40e2-8dad-8e0950da0496 req-7e19d733-90e0-487f-b417-fef980fce4e6 service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-069da92f-7399-40e2-8dad-8e0950da0496 req-7e19d733-90e0-487f-b417-fef980fce4e6 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-069da92f-7399-40e2-8dad-8e0950da0496 req-7e19d733-90e0-487f-b417-fef980fce4e6 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-069da92f-7399-40e2-8dad-8e0950da0496 req-7e19d733-90e0-487f-b417-fef980fce4e6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:41 user nova-compute[76049]: WARNING nova.compute.manager [req-069da92f-7399-40e2-8dad-8e0950da0496 req-7e19d733-90e0-487f-b417-fef980fce4e6 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state building and task_state spawning.
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "2e94785d-54bf-499f-a06c-9b96ff7717bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:41 user nova-compute[76049]: INFO nova.compute.manager [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Terminating instance
Nov 15 11:14:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Instance destroyed successfully.
Nov 15 11:14:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lazy-loading 'resources' on Instance uuid 2e94785d-54bf-499f-a06c-9b96ff7717bc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-909721055',display_name='tempest-VolumesActionsTest-instance-909721055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-909721055',id=15,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:12:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e58ca5ef511414d9faadad3a3ad8279',ramdisk_id='',reservation_id='r-s15fj592',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1276343229',owner_user_name='tempest-VolumesActionsTest-1276343229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:12:58Z,user_data=None,user_id='39adb4a06ee64e4ab6206842b79f5e51',uuid=2e94785d-54bf-499f-a06c-9b96ff7717bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converting VIF {"id": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "address": "fa:16:3e:a5:f3:50", "network": {"id": "99a5f6ab-7522-4568-9930-539e1f970bac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-409175935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e58ca5ef511414d9faadad3a3ad8279", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ed6c86-f2", "ovs_interfaceid": "97ed6c86-f21e-466d-8b6a-393ddec792b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f3:50,bridge_name='br-int',has_traffic_filtering=True,id=97ed6c86-f21e-466d-8b6a-393ddec792b6,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ed6c86-f2') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG os_vif [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f3:50,bridge_name='br-int',has_traffic_filtering=True,id=97ed6c86-f21e-466d-8b6a-393ddec792b6,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ed6c86-f2') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97ed6c86-f2, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d4e2ab2-8c57-4d98-aebe-595b851bc469) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:42 user nova-compute[76049]: INFO os_vif [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f3:50,bridge_name='br-int',has_traffic_filtering=True,id=97ed6c86-f21e-466d-8b6a-393ddec792b6,network=Network(99a5f6ab-7522-4568-9930-539e1f970bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ed6c86-f2')
Nov 15 11:14:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Deleting instance files /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc_del
Nov 15 11:14:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Deletion of /opt/stack/data/nova/instances/2e94785d-54bf-499f-a06c-9b96ff7717bc_del complete
Nov 15 11:14:42 user nova-compute[76049]: INFO nova.compute.manager [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 11:14:42 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:14:42 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:43 user nova-compute[76049]: WARNING nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state building and task_state spawning.
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received event network-vif-unplugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Acquiring lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] No waiting events found dispatching network-vif-unplugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received event network-vif-unplugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received event network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Acquiring lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] No waiting events found dispatching network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:14:43 user nova-compute[76049]: WARNING nova.compute.manager [req-28ed77ed-5754-4b77-9755-2a96b7f17c93 req-a07e6777-671c-4faf-a671-5375b60a01d2 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received unexpected event network-vif-plugged-97ed6c86-f21e-466d-8b6a-393ddec792b6 for instance with vm_state active and task_state deleting.
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:43 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Took 0.65 seconds to deallocate network for instance.
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8b69410-6d1b-4a95-8e9f-fa4e217a4750 req-99c67ee2-24ef-41dd-8dca-e92da8995906 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Received event network-vif-deleted-97ed6c86-f21e-466d-8b6a-393ddec792b6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:43 user nova-compute[76049]: INFO nova.compute.manager [req-d8b69410-6d1b-4a95-8e9f-fa4e217a4750 req-99c67ee2-24ef-41dd-8dca-e92da8995906 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Neutron deleted interface 97ed6c86-f21e-466d-8b6a-393ddec792b6; detaching it from the instance and deleting it from the info cache
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-d8b69410-6d1b-4a95-8e9f-fa4e217a4750 req-99c67ee2-24ef-41dd-8dca-e92da8995906 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:14:43 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance spawned successfully.
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8b69410-6d1b-4a95-8e9f-fa4e217a4750 req-99c67ee2-24ef-41dd-8dca-e92da8995906 service nova] [instance: 2e94785d-54bf-499f-a06c-9b96ff7717bc] Detach interface failed, port_id=97ed6c86-f21e-466d-8b6a-393ddec792b6, reason: Instance 2e94785d-54bf-499f-a06c-9b96ff7717bc could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:43 user nova-compute[76049]: INFO nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:14:43 user nova-compute[76049]: INFO nova.compute.manager [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Took 7.48 seconds to build instance.
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb6619b0-2490-467a-a91d-ae878a86398c tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.632s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:14:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:43 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Deleted allocations for instance 2e94785d-54bf-499f-a06c-9b96ff7717bc
Nov 15 11:14:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e91a1190-8872-4041-becc-ead4afc51e12 tempest-VolumesActionsTest-1276343229 tempest-VolumesActionsTest-1276343229-project-member] Lock "2e94785d-54bf-499f-a06c-9b96ff7717bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-changed-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Refreshing instance network info cache due to event network-changed-3ec8688b-5908-4fa1-9ac2-8b707adf08f1. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] Acquiring lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] Acquired lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Refreshing network info cache for port 3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Updated VIF entry in instance network info cache for port 3ec8688b-5908-4fa1-9ac2-8b707adf08f1. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Updating instance_info_cache with network_info: [{"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:14:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-546acfab-80d3-4fec-af82-dee94c2f8879 req-12d23cb5-803a-4e4d-b201-61f30ff19518 service nova] Releasing lock "refresh_cache-e85673b8-ef01-4635-9b47-c4935778dba4" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:14:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lazy-loading 'flavor' on Instance uuid e85673b8-ef01-4635-9b47-c4935778dba4 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.010s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:14:54 user nova-compute[76049]: INFO nova.compute.manager [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Attaching volume db4fa90a-b183-4b36-96c8-7fdd6982c322 to /dev/vdb
Nov 15 11:14:54 user nova-compute[76049]: DEBUG os_brick.utils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0efcfc0-416f-4d74-8c5e-e58a3812854e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb74cda-ff07-4ad8-a978-1983109d7b09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[90298211-d9fa-48be-ba06-4c80b03bfe34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61ef218-47e2-4a54-8070-8c687cd4d712]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:14:54 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:14:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8501f9-e309-418c-bcbf-485faac019ea]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG os_brick.utils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:14:54 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Updating existing volume attachment record: 53d324db-e853-4094-82b1-11bfaaf2f492 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:14:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbigEftA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:14:59 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:14:59 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:14:59 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0fa4f0-a86a-48c2-b22b-64d5439f456b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:14:59 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00c09cc-38fc-47f9-83d4-2ae9dbb0459f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322] added
Nov 15 11:14:59 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2227d97d-e71a-4214-98d4-da492929ee26]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[07588207-7baa-46f4-bbd0-f688ec320027]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbigEftA {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbigEftA" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5005b7d4-5f4c-4b20-94ec-70031960dde8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WbigEftA'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff63587-78e8-438d-9a4f-950c9882f421]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[302f4922-8be7-498e-a020-0327d577e210]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:14:59 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:14:59 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:14:59 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:14:59 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:14:59 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea45f42-b260-4f1b-be15-068fe98d5e72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260]
Nov 15 11:15:00 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbb3147-fcac-4912-b576-daa5ddcfaa60]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2409d2a6-027a-49f0-9c57-ce1132cba937]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:15:00 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:00 user nova-compute[76049]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)
Nov 15 11:15:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:15:00 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:00 user nova-compute[76049]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)
Nov 15 11:15:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66655f5-f08e-407c-a863-ad5626949d52]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbigEftA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:00 user nova-compute[76049]: INFO nova.compute.manager [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Detaching volume b330ded1-6ebc-420f-84a8-2f095f0e1a2c
Nov 15 11:15:00 user nova-compute[76049]: INFO nova.virt.block_device [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Attempting to driver detach volume b330ded1-6ebc-420f-84a8-2f095f0e1a2c from mountpoint /dev/vdc
Nov 15 11:15:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Attempting to detach device vdc from instance d23b5032-89df-47d6-93fa-496bd3d5671c from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:15:00 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:00 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:15:00 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:15:00 user nova-compute[76049]:   <serial>b330ded1-6ebc-420f-84a8-2f095f0e1a2c</serial>
Nov 15 11:15:00 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:15:00 user nova-compute[76049]: </disk>
Nov 15 11:15:00 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:15:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully detached device vdc from instance d23b5032-89df-47d6-93fa-496bd3d5671c from the persistent domain config.
Nov 15 11:15:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d23b5032-89df-47d6-93fa-496bd3d5671c from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:15:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:15:00 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:00 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:15:00 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:15:00 user nova-compute[76049]:   <serial>b330ded1-6ebc-420f-84a8-2f095f0e1a2c</serial>
Nov 15 11:15:00 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:15:00 user nova-compute[76049]: </disk>
Nov 15 11:15:00 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23265333034313339', 'path': '/dev/sdd'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265333034313339', 'path': '/dev/sdd'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG nova.objects.instance [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lazy-loading 'flavor' on Instance uuid e85673b8-ef01-4635-9b47-c4935778dba4 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:15:01 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:01 user nova-compute[76049]:   <source dev="/dev/sdd"/>
Nov 15 11:15:01 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:15:01 user nova-compute[76049]:   <serial>db4fa90a-b183-4b36-96c8-7fdd6982c322</serial>
Nov 15 11:15:01 user nova-compute[76049]: </disk>
Nov 15 11:15:01 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] No VIF found with MAC fa:16:3e:74:7a:15, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:15:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-520c2a1a-29cd-4145-bf55-233764b7a444 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.235s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:04 user nova-compute[76049]: INFO nova.compute.manager [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Detaching volume db4fa90a-b183-4b36-96c8-7fdd6982c322
Nov 15 11:15:04 user nova-compute[76049]: INFO nova.virt.block_device [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Attempting to driver detach volume db4fa90a-b183-4b36-96c8-7fdd6982c322 from mountpoint /dev/vdb
Nov 15 11:15:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Attempting to detach device vdb from instance e85673b8-ef01-4635-9b47-c4935778dba4 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:15:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:15:04 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:04 user nova-compute[76049]:   <source dev="/dev/sdd"/>
Nov 15 11:15:04 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:15:04 user nova-compute[76049]:   <serial>db4fa90a-b183-4b36-96c8-7fdd6982c322</serial>
Nov 15 11:15:04 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:15:04 user nova-compute[76049]: </disk>
Nov 15 11:15:04 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:15:04 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Successfully detached device vdb from instance e85673b8-ef01-4635-9b47-c4935778dba4 from the persistent domain config.
Nov 15 11:15:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e85673b8-ef01-4635-9b47-c4935778dba4 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:15:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:15:04 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:04 user nova-compute[76049]:   <source dev="/dev/sdd"/>
Nov 15 11:15:04 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:15:04 user nova-compute[76049]:   <serial>db4fa90a-b183-4b36-96c8-7fdd6982c322</serial>
Nov 15 11:15:04 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:15:04 user nova-compute[76049]: </disk>
Nov 15 11:15:04 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:15:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e85673b8-ef01-4635-9b47-c4935778dba4 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:15:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:15:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:15:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:15:15 user nova-compute[76049]: INFO nova.compute.claims [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Claim successful on node user
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Skipping network cache update for instance because it is Building. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid cc582aae-00f7-4c3d-b551-a70aac92d7ac {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:15:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:15:15 user nova-compute[76049]: DEBUG nova.policy [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac7d77f50629413bb7b6c9457156af67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0917737287484e2498e2dcf616b8679e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:15:15 user nova-compute[76049]: INFO nova.virt.block_device [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Booting with volume snapshot 3f314a8a-afb7-44f4-95f3-e868f099c396 at /dev/vda
Nov 15 11:15:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updating instance_info_cache with network_info: [{"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-cc582aae-00f7-4c3d-b551-a70aac92d7ac" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:15:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:15:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Successfully created port: 74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:15:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Successfully updated port: 74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "refresh_cache-aa3ac951-6d58-424d-87d7-0ffa2cc41638" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquired lock "refresh_cache-aa3ac951-6d58-424d-87d7-0ffa2cc41638" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received event network-changed-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Refreshing instance network info cache due to event network-changed-74301e0f-628e-4db9-9c9e-873384361203. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] Acquiring lock "refresh_cache-aa3ac951-6d58-424d-87d7-0ffa2cc41638" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Updating instance_info_cache with network_info: [{"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Releasing lock "refresh_cache-aa3ac951-6d58-424d-87d7-0ffa2cc41638" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Instance network_info: |[{"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] Acquired lock "refresh_cache-aa3ac951-6d58-424d-87d7-0ffa2cc41638" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Refreshing network info cache for port 74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Updated VIF entry in instance network info cache for port 74301e0f-628e-4db9-9c9e-873384361203. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Updating instance_info_cache with network_info: [{"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a6633740-3138-49b8-be16-36de0e60a43c req-519da8f6-8fc2-4ee4-8196-962540735a28 service nova] Releasing lock "refresh_cache-aa3ac951-6d58-424d-87d7-0ffa2cc41638" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:15:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:15:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:20 user nova-compute[76049]: INFO nova.compute.manager [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Terminating instance
Nov 15 11:15:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-3b9aaf4c-c6eb-469c-9cd4-5d3dcfcc0425 req-95009f2c-3c7c-4549-adb4-84bc6e6b759c service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-vif-unplugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3b9aaf4c-c6eb-469c-9cd4-5d3dcfcc0425 req-95009f2c-3c7c-4549-adb4-84bc6e6b759c service nova] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3b9aaf4c-c6eb-469c-9cd4-5d3dcfcc0425 req-95009f2c-3c7c-4549-adb4-84bc6e6b759c service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3b9aaf4c-c6eb-469c-9cd4-5d3dcfcc0425 req-95009f2c-3c7c-4549-adb4-84bc6e6b759c service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-3b9aaf4c-c6eb-469c-9cd4-5d3dcfcc0425 req-95009f2c-3c7c-4549-adb4-84bc6e6b759c service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] No waiting events found dispatching network-vif-unplugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-3b9aaf4c-c6eb-469c-9cd4-5d3dcfcc0425 req-95009f2c-3c7c-4549-adb4-84bc6e6b759c service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-vif-unplugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "8697e4ed-461e-4544-8137-faf180d111be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:15:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d23b5032-89df-47d6-93fa-496bd3d5671c is timed out.
Nov 15 11:15:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully detached device vdc from instance d23b5032-89df-47d6-93fa-496bd3d5671c from the live domain config.
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOsYCdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:21 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e225b-673b-4b86-b1b0-936c93b4c127]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:15:21 user nova-compute[76049]: No targets found.
Nov 15 11:15:21 user nova-compute[76049]: iSNS:
Nov 15 11:15:21 user nova-compute[76049]: No targets found.
Nov 15 11:15:21 user nova-compute[76049]: STATIC:
Nov 15 11:15:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c
Nov 15 11:15:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:15:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322
Nov 15 11:15:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:21 user nova-compute[76049]: FIRMWARE:
Nov 15 11:15:21 user nova-compute[76049]: No targets found.
Nov 15 11:15:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:15:21 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:15:21 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482359a-e3ba-4dc3-982a-8dece7a51466]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:15:21 user nova-compute[76049]: INFO nova.compute.claims [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Claim successful on node user
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7315d98-8808-4fc9-af0e-41c67dae42c7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:15:21 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:21 user nova-compute[76049]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)
Nov 15 11:15:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c (non-flash)
Nov 15 11:15:21 user nova-compute[76049]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:21 user nova-compute[76049]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)
Nov 15 11:15:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62942b81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d467ec-267f-46db-8f34-63bc53eb848f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Instance destroyed successfully.
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.objects.instance [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lazy-loading 'resources' on Instance uuid cc582aae-00f7-4c3d-b551-a70aac92d7ac {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[50efb475-5925-468e-8439-f2adba5bdaa5]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1269978556',display_name='tempest-VolumesAdminNegativeTest-server-1269978556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1269978556',id=3,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX0Qmywz6xgzg3LhZJtVqH7jdeBItRv7Bd4F3K4A8udUQhppO2GzDZyULG2rmhk7aWQbnamvLttwh/MjnWwkguFg6brZl4kfYt5kO9Wmq2N/NLLd/wIOnf7hzWgnTShtQ==',key_name='tempest-keypair-943534225',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:09:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b1b6dce9c3847f1be9a07015b683421',ramdisk_id='',reservation_id='r-adh9jzki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-448739573',owner_user_name='tempest-VolumesAdminNegativeTest-448739573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='543673d5b4f241df830806894717043f',uuid=cc582aae-00f7-4c3d-b551-a70aac92d7ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converting VIF {"id": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "address": "fa:16:3e:f7:b6:6c", "network": {"id": "2f9f985c-7930-4a48-a785-008aa5a1be90", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406395545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b1b6dce9c3847f1be9a07015b683421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa140e7-30", "ovs_interfaceid": "1aa140e7-30ef-4482-a23f-d95d0b2a9da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b6:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aa140e7-30ef-4482-a23f-d95d0b2a9da9,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa140e7-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_vif [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b6:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aa140e7-30ef-4482-a23f-d95d0b2a9da9,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa140e7-30') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aa140e7-30, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5291ad3-bfcb-46e1-9e72-2f4d832a7934]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b249fb1-8154-44e3-a15a-e40a1c04151a) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:21 user nova-compute[76049]: INFO os_vif [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b6:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aa140e7-30ef-4482-a23f-d95d0b2a9da9,network=Network(2f9f985c-7930-4a48-a785-008aa5a1be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa140e7-30')
Nov 15 11:15:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Deleting instance files /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac_del
Nov 15 11:15:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Deletion of /opt/stack/data/nova/instances/cc582aae-00f7-4c3d-b551-a70aac92d7ac_del complete
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.utils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe22855c-7441-44c8-ab88-5adcc983dd65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc88a23b-1672-4784-98c4-e05803f064a6]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462f723-3ed3-4cc4-9c0e-73b05a7e1f2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:21 user nova-compute[76049]: INFO nova.compute.manager [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6895724c-fa1c-4dcd-a1fc-5b40ec32f2e9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d140a83f-8db0-446b-bce8-f64de95a2c07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a135785-93cb-4061-b1a2-697ae746d385]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c4f59-ff66-40f0-8c80-7a3cecf5b103]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260]
Nov 15 11:15:21 user nova-compute[76049]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:21 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5edf016-ca07-4e04-84f9-5f4816db7431]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.utils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Updating existing volume attachment record: ed13dcf9-1cf9-49f8-94d9-a0f98a40df48 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b330ded1-6ebc-420f-84a8-2f095f0e1a2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cb23da-c3d5-49ee-a508-038b3d408588]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] <== disconnect_volume: return (348ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:15:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:15:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.policy [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bd63b00a9c4f8983e335cf898f77ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a9fe3c211d4bb78b9c6878147a9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:22 user nova-compute[76049]: INFO nova.virt.block_device [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Booting with blank volume at /dev/vda
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:22 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Took 0.89 seconds to deallocate network for instance.
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-a3276b4c-632b-49f2-b34d-78e0d055e630 req-200be98a-41bd-4bc5-825c-4a94a0ed9b84 service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-vif-deleted-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'flavor' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a84a0441-d0af-44a6-9755-8613ebf76b6b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.914s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Successfully created port: 4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:15:22 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.573s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.524s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-3833409c-c64c-48e8-8e67-7394145977e0 req-99d2b11e-b796-4ff5-b6fd-c30bff832e5e service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received event network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3833409c-c64c-48e8-8e67-7394145977e0 req-99d2b11e-b796-4ff5-b6fd-c30bff832e5e service nova] Acquiring lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3833409c-c64c-48e8-8e67-7394145977e0 req-99d2b11e-b796-4ff5-b6fd-c30bff832e5e service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3833409c-c64c-48e8-8e67-7394145977e0 req-99d2b11e-b796-4ff5-b6fd-c30bff832e5e service nova] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-3833409c-c64c-48e8-8e67-7394145977e0 req-99d2b11e-b796-4ff5-b6fd-c30bff832e5e service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] No waiting events found dispatching network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:23 user nova-compute[76049]: WARNING nova.compute.manager [req-3833409c-c64c-48e8-8e67-7394145977e0 req-99d2b11e-b796-4ff5-b6fd-c30bff832e5e service nova] [instance: cc582aae-00f7-4c3d-b551-a70aac92d7ac] Received unexpected event network-vif-plugged-1aa140e7-30ef-4482-a23f-d95d0b2a9da9 for instance with vm_state deleted and task_state None.
Nov 15 11:15:23 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Deleted allocations for instance cc582aae-00f7-4c3d-b551-a70aac92d7ac
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-01b8fd57-5ff8-44d8-9599-116c273493aa tempest-VolumesAdminNegativeTest-448739573 tempest-VolumesAdminNegativeTest-448739573-project-member] Lock "cc582aae-00f7-4c3d-b551-a70aac92d7ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Successfully updated port: 4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating instance_info_cache with network_info: [{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance network_info: |[{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e85673b8-ef01-4635-9b47-c4935778dba4 is timed out.
Nov 15 11:15:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Successfully detached device vdb from instance e85673b8-ef01-4635-9b47-c4935778dba4 from the live domain config.
Nov 15 11:15:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbigEftA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:24 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4d0d5e-5002-479b-a072-d4014c9f3690]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:15:24 user nova-compute[76049]: No targets found.
Nov 15 11:15:24 user nova-compute[76049]: iSNS:
Nov 15 11:15:24 user nova-compute[76049]: No targets found.
Nov 15 11:15:24 user nova-compute[76049]: STATIC:
Nov 15 11:15:24 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:15:24 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:24 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:24 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322
Nov 15 11:15:24 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:24 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:24 user nova-compute[76049]: FIRMWARE:
Nov 15 11:15:24 user nova-compute[76049]: No targets found.
Nov 15 11:15:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:15:24 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:15:24 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c1f8f-cb4f-4adc-9479-17853c09d8b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e37d0-2939-4e5f-8d35-00b3df4929d5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:24 user nova-compute[76049]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)
Nov 15 11:15:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:24 user nova-compute[76049]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 (non-flash)
Nov 15 11:15:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629416d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322'): ({'sdd'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Removing single pathed devices sdd {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[368bf12f-12f7-4140-8147-c2ee1ef59779]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf5327-7cc0-4cf1-8267-bc38ed804f1d]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Flushing IO for device /dev/sdd {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06343f4-6122-45b0-a224-80e7126cd7ae]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0c10f7-40e0-48d2-8df8-dea9dbb226e8]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] SCSI volumes sdd have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22ea32-a094-4c5c-a6ad-5b9dd9390285]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d475020a-4dfb-45f3-b445-672a6fe61cbb]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260]
Nov 15 11:15:24 user nova-compute[76049]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4fa90a-b183-4b36-96c8-7fdd6982c322 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb066749-d8d1-4b07-890c-e2f1933d9b7d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] <== disconnect_volume: return (355ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-changed-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Refreshing instance network info cache due to event network-changed-4ec20e73-a139-4cb2-82ac-524d080ad9e9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] Acquiring lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] Acquired lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Refreshing network info cache for port 4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updated VIF entry in instance network info cache for port 4ec20e73-a139-4cb2-82ac-524d080ad9e9. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating instance_info_cache with network_info: [{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] Releasing lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-changed-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Refreshing instance network info cache due to event network-changed-b35c63a9-bd65-4a46-a9bd-87decd1daeb8. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] Acquiring lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] Acquired lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Refreshing network info cache for port b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lazy-loading 'flavor' on Instance uuid e85673b8-ef01-4635-9b47-c4935778dba4 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f6206d4c-5dc5-4b72-8668-b2284b9d5c25 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updated VIF entry in instance network info cache for port b35c63a9-bd65-4a46-a9bd-87decd1daeb8. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:26 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:15:26 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=25.45598602294922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b31745d-5bde-4c61-94b9-363a16a77515 req-cd8b8eb4-6335-40c1-8a21-e4d8d9adfdea service nova] Releasing lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:15:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Creating image(s)
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Ensure instance console log exists: /opt/stack/data/nova/instances/aa3ac951-6d58-424d-87d7-0ffa2cc41638/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Start _get_guest_xml network_info=[{"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eluhgzxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa3ac951-6d58-424d-87d7-0ffa2cc41638', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9fce661-d341-404b-9289-fff6464a496a', 'serial': 'c9fce661-d341-404b-9289-fff6464a496a'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'ed13dcf9-1cf9-49f8-94d9-a0f98a40df48', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance e85673b8-ef01-4635-9b47-c4935778dba4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d23b5032-89df-47d6-93fa-496bd3d5671c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a4313390-b944-4fb4-880f-9868d6932977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 00bc4c99-4801-474c-85ad-13534fe75469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 692c3208-4d15-4aa6-beca-87a1d2a01e40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance aa3ac951-6d58-424d-87d7-0ffa2cc41638 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:15:26 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:15:26 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eluhgzxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:26 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:26 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:26 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c28e10f-5b62-49d5-812d-fed513dfd160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:15:26 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c0190-ac6e-4415-8ff8-40a29572db18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a] added
Nov 15 11:15:26 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a0a3e7-3996-4879-a10f-98004e041741]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097a56f-4642-49ad-b975-4bfaff91caab]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eluhgzxn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eluhgzxn" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[855953d1-e594-44d5-ad4a-403c1fd16f59]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eluhgzxn'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a58881-2122-4069-9c64-011d42591411]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[408661d2-eeca-4ef6-b801-fcebcf80e189]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f0f4a3-4b11-4a7d-9f0b-740a5e714e05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260]
Nov 15 11:15:27 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb95621-3059-430c-87be-b4fd066714ce]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7f012d-54fe-4264-bb0f-5816b4594de8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:27 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:27 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:27 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd99f4fc-b12e-47cf-9a78-56253b458d36]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eluhgzxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.utils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7cd9f5-fccd-437f-85f3-df197eceb88b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdeb6dd-17e9-45ce-b2bd-10a09b3cce32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[95620730-26f4-490c-a14a-3245a2fdb056]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[378182a1-6012-4d47-b451-dfab5e5ffcb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:27 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:15:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412952c-b34f-4da3-85d1-20c34eaa6824]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG os_brick.utils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:27 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating existing volume attachment record: bf8aa130-624c-4ced-a835-eb2d52e076e1 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26136646532623865', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136646532623865', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:15:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2040530325',display_name='tempest-TestVolumeBootPattern-server-2040530325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2040530325',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-4j1ugt40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:15:16Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=aa3ac951-6d58-424d-87d7-0ffa2cc41638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:bd:ed,bridge_name='br-int',has_traffic_filtering=True,id=74301e0f-628e-4db9-9c9e-873384361203,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74301e0f-62') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'pci_devices' on Instance uuid aa3ac951-6d58-424d-87d7-0ffa2cc41638 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:15:28 user nova-compute[76049]:   <uuid>aa3ac951-6d58-424d-87d7-0ffa2cc41638</uuid>
Nov 15 11:15:28 user nova-compute[76049]:   <name>instance-00000017</name>
Nov 15 11:15:28 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:15:28 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:15:28 user nova-compute[76049]:   <metadata>
Nov 15 11:15:28 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:15:28 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:15:28 user nova-compute[76049]:       <nova:name>tempest-TestVolumeBootPattern-server-2040530325</nova:name>
Nov 15 11:15:28 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:15:26</nova:creationTime>
Nov 15 11:15:28 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:15:28 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:15:28 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:15:28 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:15:28 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:15:28 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:15:28 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:15:28 user nova-compute[76049]:       <nova:owner>
Nov 15 11:15:28 user nova-compute[76049]:         <nova:user uuid="ac7d77f50629413bb7b6c9457156af67">tempest-TestVolumeBootPattern-2118546811-project-member</nova:user>
Nov 15 11:15:28 user nova-compute[76049]:         <nova:project uuid="0917737287484e2498e2dcf616b8679e">tempest-TestVolumeBootPattern-2118546811</nova:project>
Nov 15 11:15:28 user nova-compute[76049]:       </nova:owner>
Nov 15 11:15:28 user nova-compute[76049]:       <nova:ports>
Nov 15 11:15:28 user nova-compute[76049]:         <nova:port uuid="74301e0f-628e-4db9-9c9e-873384361203">
Nov 15 11:15:28 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:15:28 user nova-compute[76049]:         </nova:port>
Nov 15 11:15:28 user nova-compute[76049]:       </nova:ports>
Nov 15 11:15:28 user nova-compute[76049]:     </nova:instance>
Nov 15 11:15:28 user nova-compute[76049]:   </metadata>
Nov 15 11:15:28 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:15:28 user nova-compute[76049]:     <system>
Nov 15 11:15:28 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:15:28 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:15:28 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:15:28 user nova-compute[76049]:       <entry name="serial">aa3ac951-6d58-424d-87d7-0ffa2cc41638</entry>
Nov 15 11:15:28 user nova-compute[76049]:       <entry name="uuid">aa3ac951-6d58-424d-87d7-0ffa2cc41638</entry>
Nov 15 11:15:28 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:15:28 user nova-compute[76049]:     </system>
Nov 15 11:15:28 user nova-compute[76049]:   </sysinfo>
Nov 15 11:15:28 user nova-compute[76049]:   <os>
Nov 15 11:15:28 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:15:28 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:15:28 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:15:28 user nova-compute[76049]:   </os>
Nov 15 11:15:28 user nova-compute[76049]:   <features>
Nov 15 11:15:28 user nova-compute[76049]:     <acpi/>
Nov 15 11:15:28 user nova-compute[76049]:     <apic/>
Nov 15 11:15:28 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:15:28 user nova-compute[76049]:   </features>
Nov 15 11:15:28 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:15:28 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:15:28 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:15:28 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:15:28 user nova-compute[76049]:   </clock>
Nov 15 11:15:28 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:15:28 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:15:28 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:15:28 user nova-compute[76049]:   </cpu>
Nov 15 11:15:28 user nova-compute[76049]:   <devices>
Nov 15 11:15:28 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:15:28 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:28 user nova-compute[76049]:       <source dev="/dev/sdc"/>
Nov 15 11:15:28 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:15:28 user nova-compute[76049]:       <serial>c9fce661-d341-404b-9289-fff6464a496a</serial>
Nov 15 11:15:28 user nova-compute[76049]:     </disk>
Nov 15 11:15:28 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:15:28 user nova-compute[76049]:       <mac address="fa:16:3e:57:bd:ed"/>
Nov 15 11:15:28 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:15:28 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:15:28 user nova-compute[76049]:       <target dev="tap74301e0f-62"/>
Nov 15 11:15:28 user nova-compute[76049]:     </interface>
Nov 15 11:15:28 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:15:28 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/aa3ac951-6d58-424d-87d7-0ffa2cc41638/console.log" append="off"/>
Nov 15 11:15:28 user nova-compute[76049]:     </serial>
Nov 15 11:15:28 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:15:28 user nova-compute[76049]:     <video>
Nov 15 11:15:28 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:15:28 user nova-compute[76049]:     </video>
Nov 15 11:15:28 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:15:28 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:15:28 user nova-compute[76049]:     </rng>
Nov 15 11:15:28 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:15:28 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:15:28 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:15:28 user nova-compute[76049]:     </memballoon>
Nov 15 11:15:28 user nova-compute[76049]:   </devices>
Nov 15 11:15:28 user nova-compute[76049]: </domain>
Nov 15 11:15:28 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:15:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2040530325',display_name='tempest-TestVolumeBootPattern-server-2040530325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2040530325',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-4j1ugt40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:15:16Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=aa3ac951-6d58-424d-87d7-0ffa2cc41638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:bd:ed,bridge_name='br-int',has_traffic_filtering=True,id=74301e0f-628e-4db9-9c9e-873384361203,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74301e0f-62') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG os_vif [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:bd:ed,bridge_name='br-int',has_traffic_filtering=True,id=74301e0f-628e-4db9-9c9e-873384361203,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74301e0f-62') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1177981-c79b-530d-9ac9-791f442cca6c', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74301e0f-62, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74301e0f-62, col_values=(('qos', UUID('45ce2103-722f-4f04-bea9-1754f3138a39')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74301e0f-62, col_values=(('external_ids', {'iface-id': '74301e0f-628e-4db9-9c9e-873384361203', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:bd:ed', 'vm-uuid': 'aa3ac951-6d58-424d-87d7-0ffa2cc41638'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:28 user nova-compute[76049]: INFO os_vif [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:bd:ed,bridge_name='br-int',has_traffic_filtering=True,id=74301e0f-628e-4db9-9c9e-873384361203,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74301e0f-62')
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:15:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No VIF found with MAC fa:16:3e:57:bd:ed, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-changed-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Refreshing instance network info cache due to event network-changed-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] Acquiring lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] Acquired lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Refreshing network info cache for port 91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG nova.objects.instance [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lazy-loading 'flavor' on Instance uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:29 user nova-compute[76049]: INFO nova.compute.manager [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Attaching volume e6b57111-212a-4e5d-9c18-a0296169c019 to /dev/vdb
Nov 15 11:15:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Updated VIF entry in instance network info cache for port 91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Updating instance_info_cache with network_info: [{"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7b6a8a60-2dd8-49fa-8b1d-dca8354a0d01 req-c73301e5-61bd-445a-a8c1-00f665e7c6d8 service nova] Releasing lock "refresh_cache-a127ec44-88e9-4c54-9f41-4e2b8e9f9700" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG os_brick.utils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e478c7e5-c8e1-49f6-9f45-919a4cf2f5f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2320408-b83a-48a6-a452-7967f7903646]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b61e18-0dd5-47bb-a175-d878677200dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b54f990-56dd-4875-a833-746f1ff92203]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:29 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:15:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf054dc4-e234-4fea-aad9-6f897c8eab8a]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG os_brick.utils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Updating existing volume attachment record: d19c426a-029f-4f3f-9d89-7f7786f9869a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:15:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-5ea462b6-86e5-4be7-a932-c563be4daa4b req-593e11da-9d68-4542-925f-3b228440abf2 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received event network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5ea462b6-86e5-4be7-a932-c563be4daa4b req-593e11da-9d68-4542-925f-3b228440abf2 service nova] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5ea462b6-86e5-4be7-a932-c563be4daa4b req-593e11da-9d68-4542-925f-3b228440abf2 service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5ea462b6-86e5-4be7-a932-c563be4daa4b req-593e11da-9d68-4542-925f-3b228440abf2 service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-5ea462b6-86e5-4be7-a932-c563be4daa4b req-593e11da-9d68-4542-925f-3b228440abf2 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] No waiting events found dispatching network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:30 user nova-compute[76049]: WARNING nova.compute.manager [req-5ea462b6-86e5-4be7-a932-c563be4daa4b req-593e11da-9d68-4542-925f-3b228440abf2 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received unexpected event network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 for instance with vm_state building and task_state spawning.
Nov 15 11:15:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-4d9e889e-fe60-4134-9d12-3001c39a2047 req-ada55e4f-caec-4f40-8576-04b2464aee27 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received event network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4d9e889e-fe60-4134-9d12-3001c39a2047 req-ada55e4f-caec-4f40-8576-04b2464aee27 service nova] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4d9e889e-fe60-4134-9d12-3001c39a2047 req-ada55e4f-caec-4f40-8576-04b2464aee27 service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4d9e889e-fe60-4134-9d12-3001c39a2047 req-ada55e4f-caec-4f40-8576-04b2464aee27 service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-4d9e889e-fe60-4134-9d12-3001c39a2047 req-ada55e4f-caec-4f40-8576-04b2464aee27 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] No waiting events found dispatching network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:32 user nova-compute[76049]: WARNING nova.compute.manager [req-4d9e889e-fe60-4134-9d12-3001c39a2047 req-ada55e4f-caec-4f40-8576-04b2464aee27 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received unexpected event network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 for instance with vm_state building and task_state spawning.
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:15:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Instance spawned successfully.
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:32 user nova-compute[76049]: INFO nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 15 11:15:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:15:32 user nova-compute[76049]: INFO nova.compute.manager [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Took 17.19 seconds to build instance.
Nov 15 11:15:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21da870c-981b-4add-bce2-f3a19682bffe tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.300s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:15:33 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Creating image(s)
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Ensure instance console log exists: /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Start _get_guest_xml network_info=[{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUPLSYyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8697e4ed-461e-4544-8137-faf180d111be', 'attached_at': '', 'detached_at': '', 'volume_id': '57f1c736-d603-4f9c-97da-630cc3e0f18c', 'serial': '57f1c736-d603-4f9c-97da-630cc3e0f18c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'bf8aa130-624c-4ced-a835-eb2d52e076e1', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:15:33 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:15:33 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUPLSYyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:33 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:33 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:33 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ea5b1-b11a-44e8-872b-6c2ae7e488b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:15:33 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e028bda4-b750-4a64-a34f-a736fef65a79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c] added
Nov 15 11:15:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f4a6f9-d6e6-4879-87eb-b68e36cf1845]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c7b032-8cf1-4c8b-8da8-dc9451676bb7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUPLSYyh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUPLSYyh" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc55b5b0-388a-49ae-89a6-90494566c933]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUPLSYyh'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ac6a61-d720-47e0-b1a4-19f38d27959b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b417071-7a67-4439-9f43-7465314dd734]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:33 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:33 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2978fc2f-c9fc-45f9-a794-dc2f033dc6a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260]
Nov 15 11:15:33 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e29e89-a230-491b-a871-e9201cb2c281]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[824e03f7-a2d7-404f-8269-eba0c403b079]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:33 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:33 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:33 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:33 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d9cff-a162-4728-bed9-548175e98340]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:15:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUPLSYyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26136386337633962', 'path': '/dev/sdd'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136386337633962', 'path': '/dev/sdd'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033587775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033587775',id=24,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-05c01rg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:15:22Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=8697e4ed-461e-4544-8137-faf180d111be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'pci_devices' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:15:34 user nova-compute[76049]:   <uuid>8697e4ed-461e-4544-8137-faf180d111be</uuid>
Nov 15 11:15:34 user nova-compute[76049]:   <name>instance-00000018</name>
Nov 15 11:15:34 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:15:34 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:15:34 user nova-compute[76049]:   <metadata>
Nov 15 11:15:34 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:15:34 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:15:34 user nova-compute[76049]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2033587775</nova:name>
Nov 15 11:15:34 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:15:33</nova:creationTime>
Nov 15 11:15:34 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:15:34 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:15:34 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:15:34 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:15:34 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:15:34 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:15:34 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:15:34 user nova-compute[76049]:       <nova:owner>
Nov 15 11:15:34 user nova-compute[76049]:         <nova:user uuid="81bd63b00a9c4f8983e335cf898f77ad">tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member</nova:user>
Nov 15 11:15:34 user nova-compute[76049]:         <nova:project uuid="25a9fe3c211d4bb78b9c6878147a9c75">tempest-ServerBootFromVolumeStableRescueTest-1027868851</nova:project>
Nov 15 11:15:34 user nova-compute[76049]:       </nova:owner>
Nov 15 11:15:34 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:15:34 user nova-compute[76049]:       <nova:ports>
Nov 15 11:15:34 user nova-compute[76049]:         <nova:port uuid="4ec20e73-a139-4cb2-82ac-524d080ad9e9">
Nov 15 11:15:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 11:15:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:15:34 user nova-compute[76049]:       </nova:ports>
Nov 15 11:15:34 user nova-compute[76049]:     </nova:instance>
Nov 15 11:15:34 user nova-compute[76049]:   </metadata>
Nov 15 11:15:34 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:15:34 user nova-compute[76049]:     <system>
Nov 15 11:15:34 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:15:34 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:15:34 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:15:34 user nova-compute[76049]:       <entry name="serial">8697e4ed-461e-4544-8137-faf180d111be</entry>
Nov 15 11:15:34 user nova-compute[76049]:       <entry name="uuid">8697e4ed-461e-4544-8137-faf180d111be</entry>
Nov 15 11:15:34 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:15:34 user nova-compute[76049]:     </system>
Nov 15 11:15:34 user nova-compute[76049]:   </sysinfo>
Nov 15 11:15:34 user nova-compute[76049]:   <os>
Nov 15 11:15:34 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:15:34 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:15:34 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:15:34 user nova-compute[76049]:   </os>
Nov 15 11:15:34 user nova-compute[76049]:   <features>
Nov 15 11:15:34 user nova-compute[76049]:     <acpi/>
Nov 15 11:15:34 user nova-compute[76049]:     <apic/>
Nov 15 11:15:34 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:15:34 user nova-compute[76049]:   </features>
Nov 15 11:15:34 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:15:34 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:15:34 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:15:34 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:15:34 user nova-compute[76049]:   </clock>
Nov 15 11:15:34 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:15:34 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:15:34 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:15:34 user nova-compute[76049]:   </cpu>
Nov 15 11:15:34 user nova-compute[76049]:   <devices>
Nov 15 11:15:34 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:15:34 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:34 user nova-compute[76049]:       <source dev="/dev/sdd"/>
Nov 15 11:15:34 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:15:34 user nova-compute[76049]:       <serial>57f1c736-d603-4f9c-97da-630cc3e0f18c</serial>
Nov 15 11:15:34 user nova-compute[76049]:     </disk>
Nov 15 11:15:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:15:34 user nova-compute[76049]:       <mac address="fa:16:3e:7a:32:13"/>
Nov 15 11:15:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:15:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:15:34 user nova-compute[76049]:       <target dev="tap4ec20e73-a1"/>
Nov 15 11:15:34 user nova-compute[76049]:     </interface>
Nov 15 11:15:34 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:15:34 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/console.log" append="off"/>
Nov 15 11:15:34 user nova-compute[76049]:     </serial>
Nov 15 11:15:34 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:15:34 user nova-compute[76049]:     <video>
Nov 15 11:15:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:15:34 user nova-compute[76049]:     </video>
Nov 15 11:15:34 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:15:34 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:15:34 user nova-compute[76049]:     </rng>
Nov 15 11:15:34 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:15:34 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:15:34 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:15:34 user nova-compute[76049]:     </memballoon>
Nov 15 11:15:34 user nova-compute[76049]:   </devices>
Nov 15 11:15:34 user nova-compute[76049]: </domain>
Nov 15 11:15:34 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033587775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033587775',id=24,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-05c01rg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:15:22Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=8697e4ed-461e-4544-8137-faf180d111be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG os_vif [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3df8267c-ea34-5ab7-808d-741e2d75424d', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ec20e73-a1, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ec20e73-a1, col_values=(('qos', UUID('d367fecb-72a5-4486-86d2-e639d811eecd')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ec20e73-a1, col_values=(('external_ids', {'iface-id': '4ec20e73-a139-4cb2-82ac-524d080ad9e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:32:13', 'vm-uuid': '8697e4ed-461e-4544-8137-faf180d111be'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:34 user nova-compute[76049]: INFO os_vif [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1')
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:15:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No VIF found with MAC fa:16:3e:7a:32:13, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:35 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9876ad5-464f-4a4d-aa75-247fc847127c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:15:35 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b4a892-0218-48b1-afa9-74b709f35e2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019] added
Nov 15 11:15:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6517f2-11ce-4078-80f0-dea007058b52]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b9a245-671a-4394-86e1-d2b4c57f28e8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjdQVxJI {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjdQVxJI" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08a361-fb72-446a-a574-023cb7a619d7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjdQVxJI'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6509d1ae-8b76-406e-b2ba-c441252f5404]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb22669-4246-42cd-bb1a-6916a298ac90]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[73212f93-f82d-46b6-b542-ced4edee60f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]
Nov 15 11:15:35 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc738e-6b8e-4998-a3fa-421b0b10eb1e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[014bffc0-a438-4aee-b5b7-3d3697552ee1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:35 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff90a34-5557-4982-b030-5c260cc2c4cc]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-f81505e5-7ca3-40d4-8a7d-4dcc14eba39a req-01aaac18-ee5c-4aae-85fd-d45246b11f62 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f81505e5-7ca3-40d4-8a7d-4dcc14eba39a req-01aaac18-ee5c-4aae-85fd-d45246b11f62 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f81505e5-7ca3-40d4-8a7d-4dcc14eba39a req-01aaac18-ee5c-4aae-85fd-d45246b11f62 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f81505e5-7ca3-40d4-8a7d-4dcc14eba39a req-01aaac18-ee5c-4aae-85fd-d45246b11f62 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-f81505e5-7ca3-40d4-8a7d-4dcc14eba39a req-01aaac18-ee5c-4aae-85fd-d45246b11f62 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:36 user nova-compute[76049]: WARNING nova.compute.manager [req-f81505e5-7ca3-40d4-8a7d-4dcc14eba39a req-01aaac18-ee5c-4aae-85fd-d45246b11f62 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state building and task_state spawning.
Nov 15 11:15:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23233656539323039', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233656539323039', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG nova.objects.instance [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lazy-loading 'flavor' on Instance uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:15:36 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:15:36 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:15:36 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:15:36 user nova-compute[76049]:   <serial>e6b57111-212a-4e5d-9c18-a0296169c019</serial>
Nov 15 11:15:36 user nova-compute[76049]: </disk>
Nov 15 11:15:36 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:15:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:15:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:15:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] No VIF found with MAC fa:16:3e:92:ed:04, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:15:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aa886168-b8fd-44fa-a27d-172c7d438fdd tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.623s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:15:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance spawned successfully.
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-1c36fbaf-f327-4a58-b749-c900c70fbc90 req-a4e1dd0d-5900-4a9e-82aa-0964c1dcaee6 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1c36fbaf-f327-4a58-b749-c900c70fbc90 req-a4e1dd0d-5900-4a9e-82aa-0964c1dcaee6 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1c36fbaf-f327-4a58-b749-c900c70fbc90 req-a4e1dd0d-5900-4a9e-82aa-0964c1dcaee6 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1c36fbaf-f327-4a58-b749-c900c70fbc90 req-a4e1dd0d-5900-4a9e-82aa-0964c1dcaee6 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-1c36fbaf-f327-4a58-b749-c900c70fbc90 req-a4e1dd0d-5900-4a9e-82aa-0964c1dcaee6 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:38 user nova-compute[76049]: WARNING nova.compute.manager [req-1c36fbaf-f327-4a58-b749-c900c70fbc90 req-a4e1dd0d-5900-4a9e-82aa-0964c1dcaee6 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state building and task_state spawning.
Nov 15 11:15:38 user nova-compute[76049]: INFO nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 11:15:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:15:38 user nova-compute[76049]: INFO nova.compute.manager [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Took 17.29 seconds to build instance.
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ab33ad0c-1fe8-4b88-a8e7-83dc480734d6 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "8697e4ed-461e-4544-8137-faf180d111be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.402s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG os_brick.utils [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67735c1-f82e-426b-aff4-8ce2e1177b09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[80256bdb-8337-490c-befa-176116099b55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d4118-ceb1-4056-a200-2e598e084c0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ca6e2-299d-4242-b981-ffe420234c13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:38 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:15:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a3bf09-8390-41af-929b-8e79e1cf9cfa]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:15:38 user nova-compute[76049]: DEBUG os_brick.utils [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:38 user nova-compute[76049]: INFO nova.compute.manager [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Swapping volume e6b57111-212a-4e5d-9c18-a0296169c019 for a425883c-cec2-4623-9b2e-3ce8d668d1ff
Nov 15 11:15:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDqoajpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a127ec44-88e9-4c54-9f41-4e2b8e9f9700', 'attached_at': '', 'detached_at': '', 'volume_id': 'a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'serial': 'a425883c-cec2-4623-9b2e-3ce8d668d1ff'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a127ec44-88e9-4c54-9f41-4e2b8e9f9700', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6b57111-212a-4e5d-9c18-a0296169c019', 'serial'} {{(pid=76049) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDqoajpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:44 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:44 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:44 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389bd29-f308-4a72-a083-cb607d53e382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:15:44 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4de156a-c219-414a-9425-b3dcae37863e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff] added
Nov 15 11:15:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7753e94-65f5-43ca-a9d7-7619add34424]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d7e83-528e-4912-ab99-ce0c6acf47ac]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDqoajpw {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDqoajpw" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef9dd45-0cef-4308-b63d-50af4a64fa84]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RDqoajpw'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e91e4-e933-4e54-9e0a-6e3c57df8e60]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cc3116-21c3-4ffb-a8a3-f3226b31c112]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)
Nov 15 11:15:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)
Nov 15 11:15:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f4f2cb-40b2-4e09-9c28-41e5d74dfc8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260]
Nov 15 11:15:44 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e473dcdb-10f3-42cd-82fc-223552c8f391]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5284df0-c644-41ce-b301-073c7c173f31]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:15:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)
Nov 15 11:15:44 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:15:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5064a8c7-8504-4c0a-8820-8a605c109729]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:15:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDqoajpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:15:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23033663061356364', 'path': '/dev/sdg'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033663061356364', 'path': '/dev/sdg'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:15:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lazy-loading 'flavor' on Instance uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 16777216 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 63963136 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 180355072 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 328204288 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 426770432 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 591396864 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 661651456 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 720371712 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 799014912 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:51 user nova-compute[76049]: INFO nova.compute.manager [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Terminating instance
Nov 15 11:15:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:15:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 799014912 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-a2b2316c-de0b-4bf7-8cc2-fc826f161597 req-fdae0d2c-8dd7-447e-9189-1b5f81c0002c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-unplugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a2b2316c-de0b-4bf7-8cc2-fc826f161597 req-fdae0d2c-8dd7-447e-9189-1b5f81c0002c service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a2b2316c-de0b-4bf7-8cc2-fc826f161597 req-fdae0d2c-8dd7-447e-9189-1b5f81c0002c service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a2b2316c-de0b-4bf7-8cc2-fc826f161597 req-fdae0d2c-8dd7-447e-9189-1b5f81c0002c service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-a2b2316c-de0b-4bf7-8cc2-fc826f161597 req-fdae0d2c-8dd7-447e-9189-1b5f81c0002c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-unplugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-a2b2316c-de0b-4bf7-8cc2-fc826f161597 req-fdae0d2c-8dd7-447e-9189-1b5f81c0002c service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-unplugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 799014912 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Instance destroyed successfully.
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.objects.instance [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'resources' on Instance uuid d23b5032-89df-47d6-93fa-496bd3d5671c {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-393013812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-393013812',id=2,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8LEUVi10YoVRk8Bt3EmnWh9/k9X2INlqp/sb6d1S9EQYyuTkFw6kJNq6qzcERUuGw5MvT+duO6T6+Uq2l2vnP4xs4tbX3GSnkbIODd2HgeX3znRsIJo5AxpueBFN8D4Q==',key_name='tempest-keypair-1888008997',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:13:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-q1vxyx50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:13:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=d23b5032-89df-47d6-93fa-496bd3d5671c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "address": "fa:16:3e:11:ea:7e", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bdc1ea-ee", "ovs_interfaceid": "b1bdc1ea-ee41-4895-8cfd-47055753f58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG os_vif [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1bdc1ea-ee, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1039412-3551-462c-81f1-98474a6549aa) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:53 user nova-compute[76049]: INFO os_vif [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ea:7e,bridge_name='br-int',has_traffic_filtering=True,id=b1bdc1ea-ee41-4895-8cfd-47055753f58c,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bdc1ea-ee')
Nov 15 11:15:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Deleting instance files /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c_del
Nov 15 11:15:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Deletion of /opt/stack/data/nova/instances/d23b5032-89df-47d6-93fa-496bd3d5671c_del complete
Nov 15 11:15:53 user nova-compute[76049]: INFO nova.compute.manager [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Took 2.08 seconds to destroy the instance on the hypervisor.
Nov 15 11:15:53 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:15:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:54 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed54a87-2a8c-4413-bd7b-a60b356739c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:15:54 user nova-compute[76049]: No targets found.
Nov 15 11:15:54 user nova-compute[76049]: iSNS:
Nov 15 11:15:54 user nova-compute[76049]: No targets found.
Nov 15 11:15:54 user nova-compute[76049]: STATIC:
Nov 15 11:15:54 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:15:54 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:54 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:54 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf
Nov 15 11:15:54 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:54 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:54 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:15:54 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:54 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:54 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a
Nov 15 11:15:54 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:54 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:54 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff
Nov 15 11:15:54 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:54 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:54 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019
Nov 15 11:15:54 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:15:54 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:15:54 user nova-compute[76049]: FIRMWARE:
Nov 15 11:15:54 user nova-compute[76049]: No targets found.
Nov 15 11:15:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:15:54 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:15:54 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67f9c96-63fc-4d91-8340-bc833ecad09b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fac926-e1e2-4f06-9936-ecf916f5be28]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:15:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00eaf544-56a6-4916-af60-622a24b7dbaf (non-flash)
Nov 15 11:15:54 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:15:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284267010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a607f4-7f60-471b-a9f9-e8b2745bba2a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec65925-faaa-4d79-b302-3ea8cb0a9ad5]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdabdd1c-05fc-4e6c-a799-7911f2a8d825]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16b2595-dc3b-427d-a9af-a4b08a42d642]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:54 user nova-compute[76049]: WARNING nova.compute.manager [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state active and task_state deleting.
Nov 15 11:15:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:54 user nova-compute[76049]: WARNING nova.compute.manager [req-25953828-fccc-46eb-86fb-1f36d59e47ce req-18a85d4f-51f9-40b0-8efc-94b6ff4bb4df service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state active and task_state deleting.
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7855c868-1fb6-488e-a0bc-48789fbded83]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f7bf94-9e8c-4b4f-a0db-e33703fe5c63]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]
Nov 15 11:15:54 user nova-compute[76049]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.
Nov 15 11:15:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea311d3f-6032-4cff-b9ad-a7a568dded1d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] <== disconnect_volume: return (376ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDqoajpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'a127ec44-88e9-4c54-9f41-4e2b8e9f9700', 'attached_at': '', 'detached_at': '', 'volume_id': 'a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'serial'} {{(pid=76049) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] swap_volume: removing Cinder connection for volume e6b57111-212a-4e5d-9c18-a0296169c019 {{(pid=76049) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:55 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Took 1.46 seconds to deallocate network for instance.
Nov 15 11:15:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:55 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Deleted allocations for instance d23b5032-89df-47d6-93fa-496bd3d5671c
Nov 15 11:15:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-32a40220-2d5c-495e-8d2e-6ace9679cf5b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.233s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] swap_volume: Updating volume e6b57111-212a-4e5d-9c18-a0296169c019 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "RDqoajpw", "auth_password": "XGqUKNZHmMtxRF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "a425883c-cec2-4623-9b2e-3ce8d668d1ff"}, "status": "reserved", "instance": "a127ec44-88e9-4c54-9f41-4e2b8e9f9700", "attached_at": "", "detached_at": "", "volume_id": "a425883c-cec2-4623-9b2e-3ce8d668d1ff", "serial": "a425883c-cec2-4623-9b2e-3ce8d668d1ff"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'no_device': None, 'attachment_id': '5e40a793-5a3f-4605-b93d-014efc470d3b'} {{(pid=76049) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 11:15:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a34915cd-2fdf-4bc1-895c-ad14e7693431 tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.329s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:56 user nova-compute[76049]: INFO nova.compute.manager [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Terminating instance
Nov 15 11:15:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:56 user nova-compute[76049]: WARNING nova.compute.manager [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state deleted and task_state None.
Nov 15 11:15:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] Acquiring lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] Lock "d23b5032-89df-47d6-93fa-496bd3d5671c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] No waiting events found dispatching network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:56 user nova-compute[76049]: WARNING nova.compute.manager [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received unexpected event network-vif-plugged-b1bdc1ea-ee41-4895-8cfd-47055753f58c for instance with vm_state deleted and task_state None.
Nov 15 11:15:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-bea9e4c3-e4d3-4a7c-b97d-8442b4dc59ab req-05042cf3-402e-491d-984f-864780daab15 service nova] [instance: d23b5032-89df-47d6-93fa-496bd3d5671c] Received event network-vif-deleted-b1bdc1ea-ee41-4895-8cfd-47055753f58c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG os_brick.utils [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022c15d-3e62-4fb1-98e5-ff447034d938]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d0d28f-32d5-40e1-891c-166a1306dd57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:15:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d8661-4be4-44ff-b6a1-7c0b9db5c5e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb6c90-0b54-4cfe-b6c2-aa02a35077aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:15:57 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ea8b11-cb0c-4932-a287-77813d831c1e]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG os_brick.utils [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:15:57 user nova-compute[76049]: INFO nova.compute.manager [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Swapping volume a425883c-cec2-4623-9b2e-3ce8d668d1ff for e6b57111-212a-4e5d-9c18-a0296169c019
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-6c7e696a-2fad-4722-b4ad-c617aff0fb69 req-b1122a2d-6ed1-4169-b4d4-a71a6105f8cc service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-vif-unplugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6c7e696a-2fad-4722-b4ad-c617aff0fb69 req-b1122a2d-6ed1-4169-b4d4-a71a6105f8cc service nova] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6c7e696a-2fad-4722-b4ad-c617aff0fb69 req-b1122a2d-6ed1-4169-b4d4-a71a6105f8cc service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6c7e696a-2fad-4722-b4ad-c617aff0fb69 req-b1122a2d-6ed1-4169-b4d4-a71a6105f8cc service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-6c7e696a-2fad-4722-b4ad-c617aff0fb69 req-b1122a2d-6ed1-4169-b4d4-a71a6105f8cc service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] No waiting events found dispatching network-vif-unplugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-6c7e696a-2fad-4722-b4ad-c617aff0fb69 req-b1122a2d-6ed1-4169-b4d4-a71a6105f8cc service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-vif-unplugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Instance destroyed successfully.
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lazy-loading 'resources' on Instance uuid e85673b8-ef01-4635-9b47-c4935778dba4 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1584705378',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1584705378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1584705',id=16,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyDMd9NO7g/FqO6k302ZwUiEuhv7verOIVLzKMwcWX7MRxv3h8TrNGo9RFoFaIGzYcDiZWz89cziZsle2aSERea8pe+lK32WfRsAy1lZ2dPey85BnLUWq+jS/TtMiDaAQ==',key_name='tempest-keypair-643396037',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc8217ae2ae946aeadc1d3d46456d39f',ramdisk_id='',reservation_id='r-n8jra204',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1237771201',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd949070af48c5b42ef0e67e9e241f',uuid=e85673b8-ef01-4635-9b47-c4935778dba4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Converting VIF {"id": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "address": "fa:16:3e:74:7a:15", "network": {"id": "6b77f575-7e76-4391-93e5-da4c3ebb6226", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1147432733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc8217ae2ae946aeadc1d3d46456d39f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec8688b-59", "ovs_interfaceid": "3ec8688b-5908-4fa1-9ac2-8b707adf08f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:7a:15,bridge_name='br-int',has_traffic_filtering=True,id=3ec8688b-5908-4fa1-9ac2-8b707adf08f1,network=Network(6b77f575-7e76-4391-93e5-da4c3ebb6226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec8688b-59') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG os_vif [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:7a:15,bridge_name='br-int',has_traffic_filtering=True,id=3ec8688b-5908-4fa1-9ac2-8b707adf08f1,network=Network(6b77f575-7e76-4391-93e5-da4c3ebb6226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec8688b-59') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ec8688b-59, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc37f7bf-6c40-46c4-8b1f-ada75e022910) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:57 user nova-compute[76049]: INFO os_vif [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:7a:15,bridge_name='br-int',has_traffic_filtering=True,id=3ec8688b-5908-4fa1-9ac2-8b707adf08f1,network=Network(6b77f575-7e76-4391-93e5-da4c3ebb6226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec8688b-59')
Nov 15 11:15:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Deleting instance files /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4_del
Nov 15 11:15:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Deletion of /opt/stack/data/nova/instances/e85673b8-ef01-4635-9b47-c4935778dba4_del complete
Nov 15 11:15:57 user nova-compute[76049]: INFO nova.compute.manager [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 11:15:57 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:15:57 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:15:58 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Took 0.79 seconds to deallocate network for instance.
Nov 15 11:15:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-044acb7b-8902-404f-9623-26f1375d93e3 req-5e927015-7f7d-4244-b7ae-9cbddb856dde service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-vif-deleted-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:15:58 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:15:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:59 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Deleted allocations for instance e85673b8-ef01-4635-9b47-c4935778dba4
Nov 15 11:15:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-21c49527-403b-4853-9602-dc1c3503c892 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201 tempest-TestServerVolumeAttachScenarioOldVersion-1237771201-project-member] Lock "e85673b8-ef01-4635-9b47-c4935778dba4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.373s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-3f05d049-432b-4faa-b1b8-4655c68d7087 req-6279f792-aa70-4be6-8046-68a1c126d47d service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received event network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:15:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3f05d049-432b-4faa-b1b8-4655c68d7087 req-6279f792-aa70-4be6-8046-68a1c126d47d service nova] Acquiring lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:15:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3f05d049-432b-4faa-b1b8-4655c68d7087 req-6279f792-aa70-4be6-8046-68a1c126d47d service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:15:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3f05d049-432b-4faa-b1b8-4655c68d7087 req-6279f792-aa70-4be6-8046-68a1c126d47d service nova] Lock "e85673b8-ef01-4635-9b47-c4935778dba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:15:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-3f05d049-432b-4faa-b1b8-4655c68d7087 req-6279f792-aa70-4be6-8046-68a1c126d47d service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] No waiting events found dispatching network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:15:59 user nova-compute[76049]: WARNING nova.compute.manager [req-3f05d049-432b-4faa-b1b8-4655c68d7087 req-6279f792-aa70-4be6-8046-68a1c126d47d service nova] [instance: e85673b8-ef01-4635-9b47-c4935778dba4] Received unexpected event network-vif-plugged-3ec8688b-5908-4fa1-9ac2-8b707adf08f1 for instance with vm_state deleted and task_state None.
Nov 15 11:16:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a127ec44-88e9-4c54-9f41-4e2b8e9f9700', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6b57111-212a-4e5d-9c18-a0296169c019', 'serial': 'e6b57111-212a-4e5d-9c18-a0296169c019'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDqoajpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'a425883c-cec2-4623-9b2e-3ce8d668d1ff'}, 'status': 'reserved', 'instance': 'a127ec44-88e9-4c54-9f41-4e2b8e9f9700', 'attached_at': '', 'detached_at': '', 'volume_id': 'a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'serial'} {{(pid=76049) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:02 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:02 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:02 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[67351b68-152a-4286-966c-bb094a3190d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:16:02 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f130ac32-607b-4929-8274-b3f0b930b6f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019] added
Nov 15 11:16:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[588bc087-d847-467b-9378-271cdf07f896]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092010f-527e-46a5-b060-766d44308178]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjdQVxJI {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-changed-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Refreshing instance network info cache due to event network-changed-0b2a48c8-242b-4d4a-b3ee-7ac418412efd. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] Acquiring lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] Acquired lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Refreshing network info cache for port 0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjdQVxJI" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a68462c-4d4a-4d3f-9006-e498872f9736]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjdQVxJI'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5a7b69-c50e-4e98-93db-659ae4256676]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0696bcb6-131a-4200-9adc-ff1f18800b9a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:16:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:16:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce2003-58c6-4ea3-9d60-4ab076acdd46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]
Nov 15 11:16:02 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.
Nov 15 11:16:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c04ece-cfdc-4c78-9661-3a6e7a9254a3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b904c76-9ba0-428e-b380-7983626fde68]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:16:02 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9fa8af-3312-4ed7-af3a-3c32a946197c]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'flavor' on Instance uuid a4313390-b944-4fb4-880f-9868d6932977 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Ignoring supplied device name: /dev/vdb
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:02 user nova-compute[76049]: INFO nova.compute.manager [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Attaching volume 618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 to /dev/vdb
Nov 15 11:16:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updated VIF entry in instance network info cache for port 0b2a48c8-242b-4d4a-b3ee-7ac418412efd. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updating instance_info_cache with network_info: [{"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-76a489bb-8181-45d5-a9ce-339d3a33b1c8 req-b26e9c5d-fed9-4053-855c-fbdf9379995f service nova] Releasing lock "refresh_cache-a4313390-b944-4fb4-880f-9868d6932977" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.utils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[304a546b-fff2-42f1-b38d-5101186bb9ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aaea67-544e-4be4-ad31-a263da9e4582]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd8b7a2-5526-4394-ad3b-625a5cf62da1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[187499b8-efe7-458e-9204-6ad4ce2a5791]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:16:03 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:16:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81fd738-978b-474f-8c55-183d7eceaeb6]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.utils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updating existing volume attachment record: 0095047c-00e2-44ed-a857-c7a58d7cfc78 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23233656539323039', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233656539323039', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:16:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lazy-loading 'flavor' on Instance uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 174063616 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 354418688 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 551550976 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 728760320 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 896532480 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 1056964608 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDqoajpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'a425883c-cec2-4623-9b2e-3ce8d668d1ff'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[26104396-f68e-4625-9365-cb341ff154f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:16:07 user nova-compute[76049]: No targets found.
Nov 15 11:16:07 user nova-compute[76049]: iSNS:
Nov 15 11:16:07 user nova-compute[76049]: No targets found.
Nov 15 11:16:07 user nova-compute[76049]: STATIC:
Nov 15 11:16:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:16:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:16:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a
Nov 15 11:16:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff
Nov 15 11:16:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019
Nov 15 11:16:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:07 user nova-compute[76049]: FIRMWARE:
Nov 15 11:16:07 user nova-compute[76049]: No targets found.
Nov 15 11:16:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:16:07 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:16:07 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6948573f-a3a7-42e1-9486-fab51d5bcce7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d94cfcb-7c3a-4a76-b0e6-feaa44e765c3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff (non-flash)
Nov 15 11:16:07 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629416ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff'): ({'sdg'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Removing single pathed devices sdg {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea16562-24cd-44d6-897b-014c0faf0e46]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[92008384-b6f0-44fc-af2c-a9b7f584ecfa]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Flushing IO for device /dev/sdg {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2839c9a-e95b-47b3-bb95-d3a96d5bcedd]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[203e583b-e28a-4f56-9fa4-70bc7b69f48d]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1753c743-6caa-4fb8-88e4-763046e30de9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing instance network info cache due to event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.network.neutron [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14aeed3-9487-4740-8767-1c4731529a46]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260]
Nov 15 11:16:08 user nova-compute[76049]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff, portal: 172.16.0.220,3260] successful.
Nov 15 11:16:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a425883c-cec2-4623-9b2e-3ce8d668d1ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0552c4a-d8dc-4351-9e07-a72d447fe986]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] <== disconnect_volume: return (324ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a127ec44-88e9-4c54-9f41-4e2b8e9f9700', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6b57111-212a-4e5d-9c18-a0296169c019', 'serial'} {{(pid=76049) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] swap_volume: removing Cinder connection for volume a425883c-cec2-4623-9b2e-3ce8d668d1ff {{(pid=76049) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.network.neutron [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updated VIF entry in instance network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG nova.network.neutron [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7c8dfa79-d0e1-4c6f-9082-9ad66874496a req-0287a1ad-acd5-4fec-a0fc-fd1b944080d5 service nova] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] swap_volume: Updating volume a425883c-cec2-4623-9b2e-3ce8d668d1ff BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bjdQVxJI", "auth_password": "gDjkdSXe2fsUbG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "e6b57111-212a-4e5d-9c18-a0296169c019"}, "status": "reserved", "instance": "a127ec44-88e9-4c54-9f41-4e2b8e9f9700", "attached_at": "", "detached_at": "", "volume_id": "e6b57111-212a-4e5d-9c18-a0296169c019", "serial": "e6b57111-212a-4e5d-9c18-a0296169c019"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e6b57111-212a-4e5d-9c18-a0296169c019', 'no_device': None, 'attachment_id': '7a8a17fb-a5f5-4fa4-afd2-15318e6370c7'} {{(pid=76049) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-460dadbb-0387-4d20-b493-44b964cc136d tempest-TestVolumeSwap-1891233548 tempest-TestVolumeSwap-1891233548-project-admin] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.186s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVeimGhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:09 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:09 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:09 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f12db3-9bb2-4b28-bd15-3db2ff4daa57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:16:09 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab626bd-88a9-465d-b87b-7efa30b5e587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275] added
Nov 15 11:16:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d5f306-3631-475f-8fbe-bed87080fddc]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0d1899-e3ca-4dea-8235-9ac7c73cfca5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVeimGhE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVeimGhE" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[769434fa-17a1-41af-871a-442be0e8e3ca]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVeimGhE'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc195a11-58da-4d0e-9f17-fbeb9332da0d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[210ed7c0-4d77-42fb-93a6-5a24c6994909]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: INFO nova.compute.manager [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] instance snapshotting
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f95e15-1568-4d65-9b5b-3034ad38376e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260]
Nov 15 11:16:09 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260] successful.
Nov 15 11:16:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d1f6d-760d-4c7b-9337-469062755ac9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[30722839-e687-41e0-8fec-64b50a05335c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:16:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Beginning live snapshot process
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c063ded-2f07-4bec-94dc-9662cc612c44]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVeimGhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:16:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:10 user nova-compute[76049]: INFO nova.compute.manager [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Detaching volume e6b57111-212a-4e5d-9c18-a0296169c019
Nov 15 11:16:10 user nova-compute[76049]: INFO nova.virt.block_device [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Attempting to driver detach volume e6b57111-212a-4e5d-9c18-a0296169c019 from mountpoint /dev/vdb
Nov 15 11:16:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Attempting to detach device vdb from instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:16:10 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:16:10 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:16:10 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:16:10 user nova-compute[76049]:   <serial>e6b57111-212a-4e5d-9c18-a0296169c019</serial>
Nov 15 11:16:10 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:16:10 user nova-compute[76049]: </disk>
Nov 15 11:16:10 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:16:10 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Successfully detached device vdb from instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 from the persistent domain config.
Nov 15 11:16:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:16:10 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:16:10 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:16:10 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:16:10 user nova-compute[76049]:   <serial>e6b57111-212a-4e5d-9c18-a0296169c019</serial>
Nov 15 11:16:10 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:16:10 user nova-compute[76049]: </disk>
Nov 15 11:16:10 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp2fxz3rh/50b2548cb3ec4684b7ca62d4ca820c13.delta 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp2fxz3rh/50b2548cb3ec4684b7ca62d4ca820c13.delta 1073741824" returned: 0 in 0.044s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:10 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 11:16:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26233616265333833', 'path': '/dev/sdf'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233616265333833', 'path': '/dev/sdf'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG nova.objects.instance [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'flavor' on Instance uuid a4313390-b944-4fb4-880f-9868d6932977 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:16:10 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:16:10 user nova-compute[76049]:   <source dev="/dev/sdf"/>
Nov 15 11:16:10 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:16:10 user nova-compute[76049]:   <serial>618f8fd0-d5e0-4c40-9542-2ef2cb2e0275</serial>
Nov 15 11:16:10 user nova-compute[76049]: </disk>
Nov 15 11:16:10 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:16:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:16:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:16:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] No VIF found with MAC fa:16:3e:1b:ba:bd, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:16:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] COPY block job progress, current cursor: 68157440 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:16:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-35e6eab9-aa7a-4202-92a3-c439e1032af8 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.949s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:16:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 11:16:12 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:16:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp2fxz3rh/50b2548cb3ec4684b7ca62d4ca820c13.delta /opt/stack/data/nova/instances/snapshots/tmpp2fxz3rh/50b2548cb3ec4684b7ca62d4ca820c13 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp2fxz3rh/50b2548cb3ec4684b7ca62d4ca820c13.delta /opt/stack/data/nova/instances/snapshots/tmpp2fxz3rh/50b2548cb3ec4684b7ca62d4ca820c13" returned: 0 in 0.486s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Snapshot extracted, beginning image upload
Nov 15 11:16:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Snapshot image upload complete
Nov 15 11:16:15 user nova-compute[76049]: INFO nova.compute.manager [None req-864103ac-eebb-4df2-8298-c752ef84301f tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Took 6.01 seconds to snapshot the instance on the hypervisor.
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_power_states {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid d0f0287a-5e2c-4a02-8490-da45ae1e86b9 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 25c772f6-5656-46b5-9461-d720314b29ae {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid a4313390-b944-4fb4-880f-9868d6932977 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid aa3ac951-6d58-424d-87d7-0ffa2cc41638 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "25c772f6-5656-46b5-9461-d720314b29ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "a4313390-b944-4fb4-880f-9868d6932977" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "00bc4c99-4801-474c-85ad-13534fe75469" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8697e4ed-461e-4544-8137-faf180d111be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "a4313390-b944-4fb4-880f-9868d6932977" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "00bc4c99-4801-474c-85ad-13534fe75469" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "25c772f6-5656-46b5-9461-d720314b29ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8697e4ed-461e-4544-8137-faf180d111be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-changed-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing instance network info cache due to event network-changed-53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG nova.network.neutron [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing network info cache for port 53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:16:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:18 user nova-compute[76049]: INFO nova.compute.manager [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Shelve offloading
Nov 15 11:16:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updated VIF entry in instance network info cache for port 53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-84b868d0-21c4-4790-8162-15220f509c8a req-41cfb935-cce4-4925-ac72-05d2af85af36 service nova] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updating instance_info_cache with network_info: [{"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance destroyed successfully.
Nov 15 11:16:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:16:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-10b15a55-e7ff-4e8a-ac1f-3c712ab89b37 req-cdd61e0b-01d1-4d44-aac7-4bc5765f0048 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-unplugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-10b15a55-e7ff-4e8a-ac1f-3c712ab89b37 req-cdd61e0b-01d1-4d44-aac7-4bc5765f0048 service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-10b15a55-e7ff-4e8a-ac1f-3c712ab89b37 req-cdd61e0b-01d1-4d44-aac7-4bc5765f0048 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-10b15a55-e7ff-4e8a-ac1f-3c712ab89b37 req-cdd61e0b-01d1-4d44-aac7-4bc5765f0048 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-10b15a55-e7ff-4e8a-ac1f-3c712ab89b37 req-cdd61e0b-01d1-4d44-aac7-4bc5765f0048 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-unplugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:20 user nova-compute[76049]: WARNING nova.compute.manager [req-10b15a55-e7ff-4e8a-ac1f-3c712ab89b37 req-cdd61e0b-01d1-4d44-aac7-4bc5765f0048 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received unexpected event network-vif-unplugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with vm_state active and task_state shelving.
Nov 15 11:16:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance destroyed successfully.
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.objects.instance [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'resources' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-408780271',display_name='tempest-TestShelveInstance-server-408780271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-408780271',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYCuXNCW/4pVjnhoKADFMrGImq6QQkGiaZ7uvbMBH77mDZowtoehfvC+we1wSh6a66bnUekMn5ts30TyXU+UiDc1BPZm5qH6ffvw8z9cxtBpzcRLa6D3oeFs0U4ypkfxQ==',key_name='tempest-TestShelveInstance-236142358',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6517681dc6ca4788a7ae3e969a9831cc',ramdisk_id='',reservation_id='r-2kbv4mks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289836315',owner_user_name='tempest-TestShelveInstance-289836315-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:14:38Z,user_data=None,user_id='842ce026504c47a993bbda489c8385a4',uuid=692c3208-4d15-4aa6-beca-87a1d2a01e40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converting VIF {"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_vif [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53fecff6-a0, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94e06268-57c3-4f74-ad33-30568c4a662c) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:20 user nova-compute[76049]: INFO os_vif [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0')
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:20 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7b4d2-61fa-4ac6-a664-9a6c65c24541]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:16:20 user nova-compute[76049]: No targets found.
Nov 15 11:16:20 user nova-compute[76049]: iSNS:
Nov 15 11:16:20 user nova-compute[76049]: No targets found.
Nov 15 11:16:20 user nova-compute[76049]: STATIC:
Nov 15 11:16:20 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275
Nov 15 11:16:20 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:20 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:20 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:16:20 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:20 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:20 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:16:20 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:20 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:20 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a
Nov 15 11:16:20 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:20 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:20 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019
Nov 15 11:16:20 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:20 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:20 user nova-compute[76049]: FIRMWARE:
Nov 15 11:16:20 user nova-compute[76049]: No targets found.
Nov 15 11:16:20 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:16:20 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:16:20 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0b14f4-fc3e-42c5-a4dd-6a70574929a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bdc3c6-e5c9-4317-ae96-0d811fa12ae6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:20 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:20 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:20 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284611d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3b02f0-c7e3-45d4-996c-7f7e09e63089]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51afbb4-07b2-43f0-823d-8d22e7b569b4]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc03b70-ee7c-475e-aa2a-b5da8099582f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee1116-eb01-48c5-a797-a71c7ba24bea]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2440a6-14e8-48fd-8aeb-5e801095e027]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[489d8667-a0c7-40a6-afa0-c3fba6839b4b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]
Nov 15 11:16:20 user nova-compute[76049]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.
Nov 15 11:16:20 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[748a5d24-0e13-4f62-a198-3614a447ec16]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] <== disconnect_volume: return (362ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:16:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Deleting instance files /opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40_del
Nov 15 11:16:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Deletion of /opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40_del complete
Nov 15 11:16:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-changed-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing instance network info cache due to event network-changed-53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG nova.network.neutron [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing network info cache for port 53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG nova.network.neutron [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updated VIF entry in instance network info cache for port 53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG nova.network.neutron [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": null, "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap53fecff6-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:22 user nova-compute[76049]: WARNING nova.compute.manager [req-0b69a219-69b2-4aff-be13-62e2fa3a67dd req-c6da20e1-2e27-4956-90e2-f6df03d69e81 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received unexpected event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with vm_state active and task_state shelving.
Nov 15 11:16:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:23 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Deleted allocations for instance 692c3208-4d15-4aa6-beca-87a1d2a01e40
Nov 15 11:16:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:23 user nova-compute[76049]: DEBUG nova.objects.instance [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'numa_topology' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:23 user nova-compute[76049]: DEBUG nova.objects.base [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Object Instance<692c3208-4d15-4aa6-beca-87a1d2a01e40> lazy-loaded attributes: resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:16:23 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:16:23 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:16:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-005d2fd6-e963-4dc3-99c6-c2dada1c0809 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.930s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:24 user nova-compute[76049]: INFO nova.compute.manager [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Detaching volume 618f8fd0-d5e0-4c40-9542-2ef2cb2e0275
Nov 15 11:16:24 user nova-compute[76049]: INFO nova.virt.block_device [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Attempting to driver detach volume 618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 from mountpoint /dev/vdb
Nov 15 11:16:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Attempting to detach device vdb from instance a4313390-b944-4fb4-880f-9868d6932977 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:16:24 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:16:24 user nova-compute[76049]:   <source dev="/dev/sdf"/>
Nov 15 11:16:24 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:16:24 user nova-compute[76049]:   <serial>618f8fd0-d5e0-4c40-9542-2ef2cb2e0275</serial>
Nov 15 11:16:24 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:16:24 user nova-compute[76049]: </disk>
Nov 15 11:16:24 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:16:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully detached device vdb from instance a4313390-b944-4fb4-880f-9868d6932977 from the persistent domain config.
Nov 15 11:16:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4313390-b944-4fb4-880f-9868d6932977 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:16:24 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:16:24 user nova-compute[76049]:   <source dev="/dev/sdf"/>
Nov 15 11:16:24 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:16:24 user nova-compute[76049]:   <serial>618f8fd0-d5e0-4c40-9542-2ef2cb2e0275</serial>
Nov 15 11:16:24 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:16:24 user nova-compute[76049]: </disk>
Nov 15 11:16:24 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4313390-b944-4fb4-880f-9868d6932977 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-changed-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Refreshing instance network info cache due to event network-changed-5ba8d621-889a-4c32-889b-d0cd4adf2472. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] Acquiring lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] Acquired lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG nova.network.neutron [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Refreshing network info cache for port 5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:16:27 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:27 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=25.44806671142578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance a4313390-b944-4fb4-880f-9868d6932977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 00bc4c99-4801-474c-85ad-13534fe75469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance aa3ac951-6d58-424d-87d7-0ffa2cc41638 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:16:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG nova.network.neutron [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updated VIF entry in instance network info cache for port 5ba8d621-889a-4c32-889b-d0cd4adf2472. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG nova.network.neutron [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cb195c74-25c3-461e-a85c-542af54646cf req-9bd8f6c8-3ce2-4cb9-ae57-87957c884c9e service nova] Releasing lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:16:28 user nova-compute[76049]: INFO nova.compute.claims [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Claim successful on node user
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:16:29 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.policy [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9846cdf834fe438e822035561c81d2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d017cbd24f46a9b371b9ba33dd9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:16:29 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Creating image(s)
Nov 15 11:16:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "/opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "/opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "a594138462d080eac2d4a4bcf0de7b90ae8fa16a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a594138462d080eac2d4a4bcf0de7b90ae8fa16a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Successfully created port: 36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.part --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.virt.images [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] 180af431-270d-4091-b0da-1c317715ef45 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.part /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:30 user nova-compute[76049]: INFO nova.compute.manager [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Attaching volume 42cd664b-e9b0-472a-8695-e0ed4c1a62e5 to /dev/vdb
Nov 15 11:16:30 user nova-compute[76049]: DEBUG os_brick.utils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6c12ba-7b5f-43d8-8972-259af745f751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb34278-960e-4f1a-978e-363fb40325fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[858804ed-fc04-46f3-8619-04c7bc31d542]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93ad8f-dea0-416b-bd59-b2f8b298d74e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:16:30 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8b17cf-87f9-400e-a6c5-bd7fe00f7993]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG os_brick.utils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating existing volume attachment record: 0ba7c420-f0f6-4946-84a7-0c3f11ad901a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.part /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.converted" returned: 0 in 0.501s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Successfully updated port: 36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquired lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing instance network info cache due to event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] Acquiring lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a594138462d080eac2d4a4bcf0de7b90ae8fa16a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.439s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "a594138462d080eac2d4a4bcf0de7b90ae8fa16a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a594138462d080eac2d4a4bcf0de7b90ae8fa16a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Releasing lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance network_info: |[{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] Acquired lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a,backing_fmt=raw /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a,backing_fmt=raw /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk 1073741824" returned: 0 in 0.052s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a594138462d080eac2d4a4bcf0de7b90ae8fa16a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:16:31 user nova-compute[76049]: INFO nova.compute.claims [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Claim successful on node user
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Cannot resize image /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Ensure instance console log exists: /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Start _get_guest_xml network_info=[{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:16:25Z,direct_url=<?>,disk_format='qcow2',id=180af431-270d-4091-b0da-1c317715ef45,min_disk=0,min_ram=0,name='tempest-scenario-img--2123651116',owner='78d017cbd24f46a9b371b9ba33dd9abb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:16:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '180af431-270d-4091-b0da-1c317715ef45'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:16:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 is timed out.
Nov 15 11:16:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Successfully detached device vdb from instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700 from the live domain config.
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjdQVxJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'e6b57111-212a-4e5d-9c18-a0296169c019'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updated VIF entry in instance network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:16:25Z,direct_url=<?>,disk_format='qcow2',id=180af431-270d-4091-b0da-1c317715ef45,min_disk=0,min_ram=0,name='tempest-scenario-img--2123651116',owner='78d017cbd24f46a9b371b9ba33dd9abb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:16:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-448703032',display_name='tempest-TestMinimumBasicScenario-server-448703032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-448703032',id=25,image_ref='180af431-270d-4091-b0da-1c317715ef45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtW7Pv/CTEQkZolMC1Q4+U0OLBqJDH32lXVA5ecs4bYB6xk4wPqW7BGdAFzo93d9FBWksP5/B0Tougn/WUp0pe1IPRc2Hi/73yasP3KFgqBSySHCk24H19TQRgkJ/PPUw==',key_name='tempest-TestMinimumBasicScenario-622609574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-fy00h2mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='180af431-270d-4091-b0da-1c317715ef45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:29Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=dc73e2e8-49f8-4c24-a03d-26619b2b5385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.objects.instance [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'pci_devices' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ef61f-689d-4147-8896-422c95130675]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:16:31 user nova-compute[76049]: No targets found.
Nov 15 11:16:31 user nova-compute[76049]: iSNS:
Nov 15 11:16:31 user nova-compute[76049]: No targets found.
Nov 15 11:16:31 user nova-compute[76049]: STATIC:
Nov 15 11:16:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275
Nov 15 11:16:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:16:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a
Nov 15 11:16:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019
Nov 15 11:16:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:31 user nova-compute[76049]: FIRMWARE:
Nov 15 11:16:31 user nova-compute[76049]: No targets found.
Nov 15 11:16:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:16:31 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:16:31 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2f9f8c96-73d7-42fd-be91-79370177a395 req-2d83115b-23f8-4fd6-928c-18284c223cc2 service nova] Releasing lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:16:31 user nova-compute[76049]:   <uuid>dc73e2e8-49f8-4c24-a03d-26619b2b5385</uuid>
Nov 15 11:16:31 user nova-compute[76049]:   <name>instance-00000019</name>
Nov 15 11:16:31 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:16:31 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:16:31 user nova-compute[76049]:   <metadata>
Nov 15 11:16:31 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:16:31 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:16:31 user nova-compute[76049]:       <nova:name>tempest-TestMinimumBasicScenario-server-448703032</nova:name>
Nov 15 11:16:31 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:16:31</nova:creationTime>
Nov 15 11:16:31 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:16:31 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:16:31 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:16:31 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:16:31 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:16:31 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:16:31 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:16:31 user nova-compute[76049]:       <nova:owner>
Nov 15 11:16:31 user nova-compute[76049]:         <nova:user uuid="9846cdf834fe438e822035561c81d2d8">tempest-TestMinimumBasicScenario-739422793-project-member</nova:user>
Nov 15 11:16:31 user nova-compute[76049]:         <nova:project uuid="78d017cbd24f46a9b371b9ba33dd9abb">tempest-TestMinimumBasicScenario-739422793</nova:project>
Nov 15 11:16:31 user nova-compute[76049]:       </nova:owner>
Nov 15 11:16:31 user nova-compute[76049]:       <nova:root type="image" uuid="180af431-270d-4091-b0da-1c317715ef45"/>
Nov 15 11:16:31 user nova-compute[76049]:       <nova:ports>
Nov 15 11:16:31 user nova-compute[76049]:         <nova:port uuid="36eca79d-0ee1-4fce-86a4-ac47c7c0d896">
Nov 15 11:16:31 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 11:16:31 user nova-compute[76049]:         </nova:port>
Nov 15 11:16:31 user nova-compute[76049]:       </nova:ports>
Nov 15 11:16:31 user nova-compute[76049]:     </nova:instance>
Nov 15 11:16:31 user nova-compute[76049]:   </metadata>
Nov 15 11:16:31 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:16:31 user nova-compute[76049]:     <system>
Nov 15 11:16:31 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:16:31 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:16:31 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:16:31 user nova-compute[76049]:       <entry name="serial">dc73e2e8-49f8-4c24-a03d-26619b2b5385</entry>
Nov 15 11:16:31 user nova-compute[76049]:       <entry name="uuid">dc73e2e8-49f8-4c24-a03d-26619b2b5385</entry>
Nov 15 11:16:31 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:16:31 user nova-compute[76049]:     </system>
Nov 15 11:16:31 user nova-compute[76049]:   </sysinfo>
Nov 15 11:16:31 user nova-compute[76049]:   <os>
Nov 15 11:16:31 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:16:31 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:16:31 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:16:31 user nova-compute[76049]:   </os>
Nov 15 11:16:31 user nova-compute[76049]:   <features>
Nov 15 11:16:31 user nova-compute[76049]:     <acpi/>
Nov 15 11:16:31 user nova-compute[76049]:     <apic/>
Nov 15 11:16:31 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:16:31 user nova-compute[76049]:   </features>
Nov 15 11:16:31 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:16:31 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:16:31 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:16:31 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:16:31 user nova-compute[76049]:   </clock>
Nov 15 11:16:31 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:16:31 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:16:31 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:16:31 user nova-compute[76049]:   </cpu>
Nov 15 11:16:31 user nova-compute[76049]:   <devices>
Nov 15 11:16:31 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:16:31 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:16:31 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk"/>
Nov 15 11:16:31 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:16:31 user nova-compute[76049]:     </disk>
Nov 15 11:16:31 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:16:31 user nova-compute[76049]:       <mac address="fa:16:3e:11:f9:3e"/>
Nov 15 11:16:31 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:16:31 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:16:31 user nova-compute[76049]:       <target dev="tap36eca79d-0e"/>
Nov 15 11:16:31 user nova-compute[76049]:     </interface>
Nov 15 11:16:31 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:16:31 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/console.log" append="off"/>
Nov 15 11:16:31 user nova-compute[76049]:     </serial>
Nov 15 11:16:31 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:16:31 user nova-compute[76049]:     <video>
Nov 15 11:16:31 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:16:31 user nova-compute[76049]:     </video>
Nov 15 11:16:31 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:16:31 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:16:31 user nova-compute[76049]:     </rng>
Nov 15 11:16:31 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:16:31 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:16:31 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:16:31 user nova-compute[76049]:     </memballoon>
Nov 15 11:16:31 user nova-compute[76049]:   </devices>
Nov 15 11:16:31 user nova-compute[76049]: </domain>
Nov 15 11:16:31 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-448703032',display_name='tempest-TestMinimumBasicScenario-server-448703032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-448703032',id=25,image_ref='180af431-270d-4091-b0da-1c317715ef45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtW7Pv/CTEQkZolMC1Q4+U0OLBqJDH32lXVA5ecs4bYB6xk4wPqW7BGdAFzo93d9FBWksP5/B0Tougn/WUp0pe1IPRc2Hi/73yasP3KFgqBSySHCk24H19TQRgkJ/PPUw==',key_name='tempest-TestMinimumBasicScenario-622609574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-fy00h2mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='180af431-270d-4091-b0da-1c317715ef45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:29Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=dc73e2e8-49f8-4c24-a03d-26619b2b5385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG os_vif [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f449bc7-a7f2-5e83-a8fe-85b05e775237', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9d2c27-c7f9-4bbe-99c1-a4430089d3bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36eca79d-0e, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36eca79d-0e, col_values=(('qos', UUID('6c4cb8d3-34f6-420c-b00d-d5754b654a71')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36eca79d-0e, col_values=(('external_ids', {'iface-id': '36eca79d-0ee1-4fce-86a4-ac47c7c0d896', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:f9:3e', 'vm-uuid': 'dc73e2e8-49f8-4c24-a03d-26619b2b5385'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:32 user nova-compute[76049]: INFO os_vif [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e')
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[72da714e-3d85-4c42-ab95-e44161ec96b2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:32 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:32 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:32 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:32 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:32 user nova-compute[76049]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 (non-flash)
Nov 15 11:16:32 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629416d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd287688-bfad-401a-bc1b-0271a00b8934]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No VIF found with MAC fa:16:3e:11:f9:3e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e598ec2-790b-418d-80dc-0b894d93cb18]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[75019d97-81f2-4c3d-b546-94c108a9ef73]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[477bec10-04d4-4352-8d96-1c28a4ff0d1a]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3666ee8-e084-4aa4-ad95-fe7441a050a8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db24606-b492-4141-9ee6-bb25b85deb55]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260]
Nov 15 11:16:32 user nova-compute[76049]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019, portal: 172.16.0.220,3260] successful.
Nov 15 11:16:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b57111-212a-4e5d-9c18-a0296169c019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138dd61-54ed-4e8f-b894-1d6689350299]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] <== disconnect_volume: return (359ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:16:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.policy [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfc6846a39a4455798a857842912c534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8953f0ed0ac04badb593529ffb2c567c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:16:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Creating image(s)
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk 1073741824" returned: 0 in 0.045s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Successfully created port: 0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lazy-loading 'flavor' on Instance uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f731f53d-1f1a-45b6-ad99-634f9683bf5a tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.882s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.540s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Cannot resize image /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Ensure instance console log exists: /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-b6ebe396-72a9-4262-823c-25b6c006c61f req-79eda188-85d9-45ae-8a98-10d3609c79f4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b6ebe396-72a9-4262-823c-25b6c006c61f req-79eda188-85d9-45ae-8a98-10d3609c79f4 service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b6ebe396-72a9-4262-823c-25b6c006c61f req-79eda188-85d9-45ae-8a98-10d3609c79f4 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b6ebe396-72a9-4262-823c-25b6c006c61f req-79eda188-85d9-45ae-8a98-10d3609c79f4 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-b6ebe396-72a9-4262-823c-25b6c006c61f req-79eda188-85d9-45ae-8a98-10d3609c79f4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:33 user nova-compute[76049]: WARNING nova.compute.manager [req-b6ebe396-72a9-4262-823c-25b6c006c61f req-79eda188-85d9-45ae-8a98-10d3609c79f4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received unexpected event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with vm_state building and task_state spawning.
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Successfully updated port: 0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquired lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-changed-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Refreshing instance network info cache due to event network-changed-0495d054-d8d9-4a64-8306-3ae999cdb253. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] Acquiring lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Releasing lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance network_info: |[{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] Acquired lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.neutron [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Refreshing network info cache for port 0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Start _get_guest_xml network_info=[{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:16:34 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:34 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lazy-loading 'pci_devices' on Instance uuid 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:16:34 user nova-compute[76049]:   <uuid>6625217c-b0a0-48c1-972c-f460acd20013</uuid>
Nov 15 11:16:34 user nova-compute[76049]:   <name>instance-0000001a</name>
Nov 15 11:16:34 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:16:34 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:16:34 user nova-compute[76049]:   <metadata>
Nov 15 11:16:34 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:16:34 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:16:34 user nova-compute[76049]:       <nova:name>tempest-ServerActionsTestOtherB-server-1158016788</nova:name>
Nov 15 11:16:34 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:16:34</nova:creationTime>
Nov 15 11:16:34 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:16:34 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:16:34 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:16:34 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:16:34 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:16:34 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:16:34 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:16:34 user nova-compute[76049]:       <nova:owner>
Nov 15 11:16:34 user nova-compute[76049]:         <nova:user uuid="dfc6846a39a4455798a857842912c534">tempest-ServerActionsTestOtherB-1283239424-project-member</nova:user>
Nov 15 11:16:34 user nova-compute[76049]:         <nova:project uuid="8953f0ed0ac04badb593529ffb2c567c">tempest-ServerActionsTestOtherB-1283239424</nova:project>
Nov 15 11:16:34 user nova-compute[76049]:       </nova:owner>
Nov 15 11:16:34 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:16:34 user nova-compute[76049]:       <nova:ports>
Nov 15 11:16:34 user nova-compute[76049]:         <nova:port uuid="0495d054-d8d9-4a64-8306-3ae999cdb253">
Nov 15 11:16:34 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 11:16:34 user nova-compute[76049]:         </nova:port>
Nov 15 11:16:34 user nova-compute[76049]:       </nova:ports>
Nov 15 11:16:34 user nova-compute[76049]:     </nova:instance>
Nov 15 11:16:34 user nova-compute[76049]:   </metadata>
Nov 15 11:16:34 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:16:34 user nova-compute[76049]:     <system>
Nov 15 11:16:34 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:16:34 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:16:34 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:16:34 user nova-compute[76049]:       <entry name="serial">6625217c-b0a0-48c1-972c-f460acd20013</entry>
Nov 15 11:16:34 user nova-compute[76049]:       <entry name="uuid">6625217c-b0a0-48c1-972c-f460acd20013</entry>
Nov 15 11:16:34 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:16:34 user nova-compute[76049]:     </system>
Nov 15 11:16:34 user nova-compute[76049]:   </sysinfo>
Nov 15 11:16:34 user nova-compute[76049]:   <os>
Nov 15 11:16:34 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:16:34 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:16:34 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:16:34 user nova-compute[76049]:   </os>
Nov 15 11:16:34 user nova-compute[76049]:   <features>
Nov 15 11:16:34 user nova-compute[76049]:     <acpi/>
Nov 15 11:16:34 user nova-compute[76049]:     <apic/>
Nov 15 11:16:34 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:16:34 user nova-compute[76049]:   </features>
Nov 15 11:16:34 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:16:34 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:16:34 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:16:34 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:16:34 user nova-compute[76049]:   </clock>
Nov 15 11:16:34 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:16:34 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:16:34 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:16:34 user nova-compute[76049]:   </cpu>
Nov 15 11:16:34 user nova-compute[76049]:   <devices>
Nov 15 11:16:34 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:16:34 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:16:34 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk"/>
Nov 15 11:16:34 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:16:34 user nova-compute[76049]:     </disk>
Nov 15 11:16:34 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:16:34 user nova-compute[76049]:       <mac address="fa:16:3e:88:80:29"/>
Nov 15 11:16:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:16:34 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:16:34 user nova-compute[76049]:       <target dev="tap0495d054-d8"/>
Nov 15 11:16:34 user nova-compute[76049]:     </interface>
Nov 15 11:16:34 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:16:34 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/console.log" append="off"/>
Nov 15 11:16:34 user nova-compute[76049]:     </serial>
Nov 15 11:16:34 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:16:34 user nova-compute[76049]:     <video>
Nov 15 11:16:34 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:16:34 user nova-compute[76049]:     </video>
Nov 15 11:16:34 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:16:34 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:16:34 user nova-compute[76049]:     </rng>
Nov 15 11:16:34 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:16:34 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:16:34 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:16:34 user nova-compute[76049]:     </memballoon>
Nov 15 11:16:34 user nova-compute[76049]:   </devices>
Nov 15 11:16:34 user nova-compute[76049]: </domain>
Nov 15 11:16:34 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG os_vif [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16e507b6-9089-50c9-81d7-056d3db5bf92', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0495d054-d8, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0495d054-d8, col_values=(('qos', UUID('daca95f5-7c14-4968-9380-00f8a9b4d5d7')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0495d054-d8, col_values=(('external_ids', {'iface-id': '0495d054-d8d9-4a64-8306-3ae999cdb253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:80:29', 'vm-uuid': '6625217c-b0a0-48c1-972c-f460acd20013'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:34 user nova-compute[76049]: INFO os_vif [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8')
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No VIF found with MAC fa:16:3e:88:80:29, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.neutron [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updated VIF entry in instance network info cache for port 0495d054-d8d9-4a64-8306-3ae999cdb253. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG nova.network.neutron [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3736c3b9-0e21-4d2b-b926-e37b38e31b32 req-aa40cd6c-b213-4d8b-94ba-ff7322012b03 service nova] Releasing lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYSJGMXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:35 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:35 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:16:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance spawned successfully.
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-e90ba2a6-1452-4330-aae8-aceb2929d48c req-2a63a7a5-4389-4502-b2a8-9bd401e88f8e service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e90ba2a6-1452-4330-aae8-aceb2929d48c req-2a63a7a5-4389-4502-b2a8-9bd401e88f8e service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e90ba2a6-1452-4330-aae8-aceb2929d48c req-2a63a7a5-4389-4502-b2a8-9bd401e88f8e service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e90ba2a6-1452-4330-aae8-aceb2929d48c req-2a63a7a5-4389-4502-b2a8-9bd401e88f8e service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-e90ba2a6-1452-4330-aae8-aceb2929d48c req-2a63a7a5-4389-4502-b2a8-9bd401e88f8e service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:35 user nova-compute[76049]: WARNING nova.compute.manager [req-e90ba2a6-1452-4330-aae8-aceb2929d48c req-2a63a7a5-4389-4502-b2a8-9bd401e88f8e service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received unexpected event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with vm_state building and task_state spawning.
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80cbee1-2e34-49a7-80de-f993310a87fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:16:35 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-2e7d9481-332b-450b-ae2e-de97e59d943b req-eece6d37-f74c-4e43-9c36-e4e9aa6e73e3 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2e7d9481-332b-450b-ae2e-de97e59d943b req-eece6d37-f74c-4e43-9c36-e4e9aa6e73e3 service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2e7d9481-332b-450b-ae2e-de97e59d943b req-eece6d37-f74c-4e43-9c36-e4e9aa6e73e3 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2e7d9481-332b-450b-ae2e-de97e59d943b req-eece6d37-f74c-4e43-9c36-e4e9aa6e73e3 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-2e7d9481-332b-450b-ae2e-de97e59d943b req-eece6d37-f74c-4e43-9c36-e4e9aa6e73e3 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:35 user nova-compute[76049]: WARNING nova.compute.manager [req-2e7d9481-332b-450b-ae2e-de97e59d943b req-eece6d37-f74c-4e43-9c36-e4e9aa6e73e3 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state building and task_state spawning.
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[47272819-fa47-40d7-bc41-374e333e4307]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5] added
Nov 15 11:16:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31915ce-0ab6-4d38-abae-930266463bb1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: INFO nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 15 11:16:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c0373-166c-4db1-bd6f-1322ed23ad9a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYSJGMXT {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYSJGMXT" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c281d2-fc6a-417c-99c0-c27a11917ec9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jYSJGMXT'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd9231f-764e-4a4c-a2af-3bbc84b5b922]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f8ae3-238e-4839-b61e-d3ec59567f25]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:35 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:35 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:35 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:35 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:35 user nova-compute[76049]: INFO nova.compute.manager [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Took 7.02 seconds to build instance.
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-301a6879-64f3-4fd7-acbc-1b5424eb708c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.118s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feed579-0268-4aad-8fb6-a2d39b5a7925]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]
Nov 15 11:16:35 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.
Nov 15 11:16:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5a51a2-e0d6-4cf0-9ef2-65ca111f95e4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c579c4a7-3152-4a9b-96ab-35b7c62b8741]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:36 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:36 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:36 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:16:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:36 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:36 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:36 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:16:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[436cb353-123f-4c22-9018-37911155dfc2]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYSJGMXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23337313730613432', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337313730613432', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:16:37 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:16:37 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:16:37 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:16:37 user nova-compute[76049]:   <serial>42cd664b-e9b0-472a-8695-e0ed4c1a62e5</serial>
Nov 15 11:16:37 user nova-compute[76049]: </disk>
Nov 15 11:16:37 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No VIF found with MAC fa:16:3e:79:34:99, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6e8ea7d7-4dd3-4b70-ac40-31b8fdbcc084 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.300s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ab3fb22-41a4-4660-b632-5b9d32846b70 req-97a7ec07-8912-4620-b13f-88cdb1d0c4be service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0ab3fb22-41a4-4660-b632-5b9d32846b70 req-97a7ec07-8912-4620-b13f-88cdb1d0c4be service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0ab3fb22-41a4-4660-b632-5b9d32846b70 req-97a7ec07-8912-4620-b13f-88cdb1d0c4be service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0ab3fb22-41a4-4660-b632-5b9d32846b70 req-97a7ec07-8912-4620-b13f-88cdb1d0c4be service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-0ab3fb22-41a4-4660-b632-5b9d32846b70 req-97a7ec07-8912-4620-b13f-88cdb1d0c4be service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:37 user nova-compute[76049]: WARNING nova.compute.manager [req-0ab3fb22-41a4-4660-b632-5b9d32846b70 req-97a7ec07-8912-4620-b13f-88cdb1d0c4be service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state building and task_state spawning.
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:16:37 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance spawned successfully.
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:37 user nova-compute[76049]: INFO nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 15 11:16:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:16:38 user nova-compute[76049]: INFO nova.compute.manager [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Took 6.37 seconds to build instance.
Nov 15 11:16:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9d91c2fa-3214-48b2-81e0-0baf8308c010 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9d91c2fa-3214-48b2-81e0-0baf8308c010 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9d91c2fa-3214-48b2-81e0-0baf8308c010 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3111d004-92d0-42f8-b623-a4a8d8c6fde9 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.565s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9d91c2fa-3214-48b2-81e0-0baf8308c010 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76049) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9d91c2fa-3214-48b2-81e0-0baf8308c010 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance destroyed successfully.
Nov 15 11:16:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9d91c2fa-3214-48b2-81e0-0baf8308c010 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9d91c2fa-3214-48b2-81e0-0baf8308c010 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.936s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:39 user nova-compute[76049]: WARNING nova.compute.manager [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state stopped and task_state None.
Nov 15 11:16:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:39 user nova-compute[76049]: WARNING nova.compute.manager [req-969a5e4d-08d9-4292-8405-b23b68399f36 req-17c37ebe-5ff1-440f-b555-387a7dadcf95 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state stopped and task_state None.
Nov 15 11:16:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4313390-b944-4fb4-880f-9868d6932977 is timed out.
Nov 15 11:16:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully detached device vdb from instance a4313390-b944-4fb4-880f-9868d6932977 from the live domain config.
Nov 15 11:16:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVeimGhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:44 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d534e46a-4c49-4866-af5c-1abc1e01c2e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:16:44 user nova-compute[76049]: No targets found.
Nov 15 11:16:44 user nova-compute[76049]: iSNS:
Nov 15 11:16:44 user nova-compute[76049]: No targets found.
Nov 15 11:16:44 user nova-compute[76049]: STATIC:
Nov 15 11:16:44 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275
Nov 15 11:16:44 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:44 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:44 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:16:44 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:44 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:44 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:16:44 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:44 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:44 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a
Nov 15 11:16:44 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:44 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:44 user nova-compute[76049]: FIRMWARE:
Nov 15 11:16:44 user nova-compute[76049]: No targets found.
Nov 15 11:16:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:16:44 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:16:44 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b68dc3-1430-4ebf-84b9-06784142093b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131a5a4-b359-4a36-adb8-0c2ae8427435]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:44 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:44 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:44 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:16:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:44 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:44 user nova-compute[76049]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 (non-flash)
Nov 15 11:16:44 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:16:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62847c7910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275'): ({'sdf'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Removing single pathed devices sdf {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0abfa-f034-44dc-a96b-f49b2a392868]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26fb3ae-81ef-49b5-b74d-cc988eb61152]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Flushing IO for device /dev/sdf {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4504ab-6d2e-4d70-b92d-df6af55b4997]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b91c8-b777-43c8-9e80-9e58402cfb3e]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f85ea7-23b0-4acc-9766-9a265d29b7b6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb3f3a-084e-4de7-84a1-572cd7688745]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260]
Nov 15 11:16:44 user nova-compute[76049]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275, portal: 172.16.0.220,3260] successful.
Nov 15 11:16:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a628a24-5055-48a5-93c0-63d0f847353d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== disconnect_volume: return (308ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:16:45 user nova-compute[76049]: INFO nova.compute.claims [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Claim successful on node user
Nov 15 11:16:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'flavor' on Instance uuid a4313390-b944-4fb4-880f-9868d6932977 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb2e42dc-0619-47b8-aaf3-9ca48794141d tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.712s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.577s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:45 user nova-compute[76049]: INFO nova.compute.manager [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Terminating instance
Nov 15 11:16:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-ba33d7a6-9804-40a6-afe8-ba4f6154ec21 req-e9fb2ffd-2e70-4258-8ba6-7c212870ae13 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-vif-unplugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ba33d7a6-9804-40a6-afe8-ba4f6154ec21 req-e9fb2ffd-2e70-4258-8ba6-7c212870ae13 service nova] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ba33d7a6-9804-40a6-afe8-ba4f6154ec21 req-e9fb2ffd-2e70-4258-8ba6-7c212870ae13 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ba33d7a6-9804-40a6-afe8-ba4f6154ec21 req-e9fb2ffd-2e70-4258-8ba6-7c212870ae13 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-ba33d7a6-9804-40a6-afe8-ba4f6154ec21 req-e9fb2ffd-2e70-4258-8ba6-7c212870ae13 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] No waiting events found dispatching network-vif-unplugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-ba33d7a6-9804-40a6-afe8-ba4f6154ec21 req-e9fb2ffd-2e70-4258-8ba6-7c212870ae13 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-vif-unplugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:16:46 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.policy [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd3cb19baf044c1ca816581576c5c243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4977c566adae433e8780d44d86f18757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:16:46 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Creating image(s)
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:46 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a4313390-b944-4fb4-880f-9868d6932977] Instance destroyed successfully.
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.objects.instance [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lazy-loading 'resources' on Instance uuid a4313390-b944-4fb4-880f-9868d6932977 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1915406476',display_name='tempest-VolumesSnapshotTestJSON-instance-1915406476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1915406476',id=19,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb2VmQc11eWTXjAemB1l4fra2afHkYSJ8K+UMdrj6R/IzNhOTQ4Hlo4P9ZpCFkpxEtSESm6Ag24sfzJn70EY9kNFnOVUrmNJuNznuDp2zA3E/m2ayPwQk8b9THHpjssqQ==',key_name='tempest-keypair-915741938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df502284cb84433a1ddd5195da15df8',ramdisk_id='',reservation_id='r-orplk4hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-753677889',owner_user_name='tempest-VolumesSnapshotTestJSON-753677889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:14:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092762011c594cb6b7badf4bbafe513e',uuid=a4313390-b944-4fb4-880f-9868d6932977,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converting VIF {"id": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "address": "fa:16:3e:1b:ba:bd", "network": {"id": "5bc62c35-6ab2-4f0e-8ea3-cbec955b151e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-83393482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df502284cb84433a1ddd5195da15df8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2a48c8-24", "ovs_interfaceid": "0b2a48c8-242b-4d4a-b3ee-7ac418412efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2a48c8-24') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_vif [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2a48c8-24') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b2a48c8-24, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92e30de6-201d-4e5f-9bce-57914d62b238) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:46 user nova-compute[76049]: INFO os_vif [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd,network=Network(5bc62c35-6ab2-4f0e-8ea3-cbec955b151e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2a48c8-24')
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVeimGhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:16:46 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.210s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[603fe863-c42b-4514-b701-06b179b786c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:16:46 user nova-compute[76049]: No targets found.
Nov 15 11:16:46 user nova-compute[76049]: iSNS:
Nov 15 11:16:46 user nova-compute[76049]: No targets found.
Nov 15 11:16:46 user nova-compute[76049]: STATIC:
Nov 15 11:16:46 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:16:46 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:46 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:46 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:16:46 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:46 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:46 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a
Nov 15 11:16:46 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:16:46 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:16:46 user nova-compute[76049]: FIRMWARE:
Nov 15 11:16:46 user nova-compute[76049]: No targets found.
Nov 15 11:16:46 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:16:46 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:16:46 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618f8fd0-d5e0-4c40-9542-2ef2cb2e0275', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec88ec3-bce5-45e9-8548-e220165b7ec2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f1b39-b0fa-4d18-8387-97fa5cb15100]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:46 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:46 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:16:46 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:16:46 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:16:46 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:16:46 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842b8af0>, {}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Disconnecting from: [] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.115s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] <== disconnect_volume: return (117ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:16:46 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Deleting instance files /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977_del
Nov 15 11:16:46 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Deletion of /opt/stack/data/nova/instances/a4313390-b944-4fb4-880f-9868d6932977_del complete
Nov 15 11:16:46 user nova-compute[76049]: INFO nova.compute.manager [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: a4313390-b944-4fb4-880f-9868d6932977] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a4313390-b944-4fb4-880f-9868d6932977] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.197s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk 1073741824" returned: 0 in 0.053s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Successfully created port: 3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Cannot resize image /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Ensure instance console log exists: /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:47 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: a4313390-b944-4fb4-880f-9868d6932977] Took 1.11 seconds to deallocate network for instance.
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-839c8065-7fb9-4226-b274-07616e59eb80 req-44af812b-0c4b-470e-b05e-96dd930bc706 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-vif-deleted-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:47 user nova-compute[76049]: INFO nova.compute.manager [req-839c8065-7fb9-4226-b274-07616e59eb80 req-44af812b-0c4b-470e-b05e-96dd930bc706 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Neutron deleted interface 0b2a48c8-242b-4d4a-b3ee-7ac418412efd; detaching it from the instance and deleting it from the info cache
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.network.neutron [req-839c8065-7fb9-4226-b274-07616e59eb80 req-44af812b-0c4b-470e-b05e-96dd930bc706 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:47 user nova-compute[76049]: WARNING nova.volume.cinder [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Attachment 0095047c-00e2-44ed-a857-c7a58d7cfc78 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0095047c-00e2-44ed-a857-c7a58d7cfc78. (HTTP 404) (Request-ID: req-5c94158a-a7c8-48d6-97b7-0f8d8b327265)
Nov 15 11:16:47 user nova-compute[76049]: INFO nova.compute.manager [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] [instance: a4313390-b944-4fb4-880f-9868d6932977] Took 0.04 seconds to detach 1 volumes for instance.
Nov 15 11:16:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-839c8065-7fb9-4226-b274-07616e59eb80 req-44af812b-0c4b-470e-b05e-96dd930bc706 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Detach interface failed, port_id=0b2a48c8-242b-4d4a-b3ee-7ac418412efd, reason: Instance a4313390-b944-4fb4-880f-9868d6932977 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-d0e6a88a-d9fd-4098-b6d6-673fb3f1d00c req-e72437ad-dec7-48f6-80c5-8c959e8467c3 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received event network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d0e6a88a-d9fd-4098-b6d6-673fb3f1d00c req-e72437ad-dec7-48f6-80c5-8c959e8467c3 service nova] Acquiring lock "a4313390-b944-4fb4-880f-9868d6932977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d0e6a88a-d9fd-4098-b6d6-673fb3f1d00c req-e72437ad-dec7-48f6-80c5-8c959e8467c3 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d0e6a88a-d9fd-4098-b6d6-673fb3f1d00c req-e72437ad-dec7-48f6-80c5-8c959e8467c3 service nova] Lock "a4313390-b944-4fb4-880f-9868d6932977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-d0e6a88a-d9fd-4098-b6d6-673fb3f1d00c req-e72437ad-dec7-48f6-80c5-8c959e8467c3 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] No waiting events found dispatching network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:48 user nova-compute[76049]: WARNING nova.compute.manager [req-d0e6a88a-d9fd-4098-b6d6-673fb3f1d00c req-e72437ad-dec7-48f6-80c5-8c959e8467c3 service nova] [instance: a4313390-b944-4fb4-880f-9868d6932977] Received unexpected event network-vif-plugged-0b2a48c8-242b-4d4a-b3ee-7ac418412efd for instance with vm_state deleted and task_state None.
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Successfully updated port: 3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquired lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing instance network info cache due to event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] Acquiring lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:48 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Deleted allocations for instance a4313390-b944-4fb4-880f-9868d6932977
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Releasing lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance network_info: |[{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] Acquired lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.neutron [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Start _get_guest_xml network_info=[{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:16:48 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:48 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331075314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331075314',id=27,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowPv+zeh5HeWFO2gWyNt655P1rLuxk9JkH05BReuni5hPcufErhaST6j3jqwNsidl8IFiUqJYYff9h02deDf9bJZdZhCLQ4n6wIW3pKPWRiijmwQyhFNj7kfO0p7Dmsg==',key_name='tempest-keypair-1390670603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-a30rqbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.objects.instance [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'pci_devices' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:16:48 user nova-compute[76049]:   <uuid>644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc</uuid>
Nov 15 11:16:48 user nova-compute[76049]:   <name>instance-0000001b</name>
Nov 15 11:16:48 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:16:48 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:16:48 user nova-compute[76049]:   <metadata>
Nov 15 11:16:48 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:16:48 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:16:48 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-331075314</nova:name>
Nov 15 11:16:48 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:16:48</nova:creationTime>
Nov 15 11:16:48 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:16:48 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:16:48 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:16:48 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:16:48 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:16:48 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:16:48 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:16:48 user nova-compute[76049]:       <nova:owner>
Nov 15 11:16:48 user nova-compute[76049]:         <nova:user uuid="fd3cb19baf044c1ca816581576c5c243">tempest-AttachVolumeShelveTestJSON-10410443-project-member</nova:user>
Nov 15 11:16:48 user nova-compute[76049]:         <nova:project uuid="4977c566adae433e8780d44d86f18757">tempest-AttachVolumeShelveTestJSON-10410443</nova:project>
Nov 15 11:16:48 user nova-compute[76049]:       </nova:owner>
Nov 15 11:16:48 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:16:48 user nova-compute[76049]:       <nova:ports>
Nov 15 11:16:48 user nova-compute[76049]:         <nova:port uuid="3681d118-3073-4666-bcc9-39f1b4b7694f">
Nov 15 11:16:48 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:16:48 user nova-compute[76049]:         </nova:port>
Nov 15 11:16:48 user nova-compute[76049]:       </nova:ports>
Nov 15 11:16:48 user nova-compute[76049]:     </nova:instance>
Nov 15 11:16:48 user nova-compute[76049]:   </metadata>
Nov 15 11:16:48 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:16:48 user nova-compute[76049]:     <system>
Nov 15 11:16:48 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:16:48 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:16:48 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:16:48 user nova-compute[76049]:       <entry name="serial">644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc</entry>
Nov 15 11:16:48 user nova-compute[76049]:       <entry name="uuid">644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc</entry>
Nov 15 11:16:48 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:16:48 user nova-compute[76049]:     </system>
Nov 15 11:16:48 user nova-compute[76049]:   </sysinfo>
Nov 15 11:16:48 user nova-compute[76049]:   <os>
Nov 15 11:16:48 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:16:48 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:16:48 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:16:48 user nova-compute[76049]:   </os>
Nov 15 11:16:48 user nova-compute[76049]:   <features>
Nov 15 11:16:48 user nova-compute[76049]:     <acpi/>
Nov 15 11:16:48 user nova-compute[76049]:     <apic/>
Nov 15 11:16:48 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:16:48 user nova-compute[76049]:   </features>
Nov 15 11:16:48 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:16:48 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:16:48 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:16:48 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:16:48 user nova-compute[76049]:   </clock>
Nov 15 11:16:48 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:16:48 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:16:48 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:16:48 user nova-compute[76049]:   </cpu>
Nov 15 11:16:48 user nova-compute[76049]:   <devices>
Nov 15 11:16:48 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:16:48 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:16:48 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk"/>
Nov 15 11:16:48 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:16:48 user nova-compute[76049]:     </disk>
Nov 15 11:16:48 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:16:48 user nova-compute[76049]:       <mac address="fa:16:3e:af:4e:e7"/>
Nov 15 11:16:48 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:16:48 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:16:48 user nova-compute[76049]:       <target dev="tap3681d118-30"/>
Nov 15 11:16:48 user nova-compute[76049]:     </interface>
Nov 15 11:16:48 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:16:48 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/console.log" append="off"/>
Nov 15 11:16:48 user nova-compute[76049]:     </serial>
Nov 15 11:16:48 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:16:48 user nova-compute[76049]:     <video>
Nov 15 11:16:48 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:16:48 user nova-compute[76049]:     </video>
Nov 15 11:16:48 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:16:48 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:16:48 user nova-compute[76049]:     </rng>
Nov 15 11:16:48 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:16:48 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:16:48 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:16:48 user nova-compute[76049]:     </memballoon>
Nov 15 11:16:48 user nova-compute[76049]:   </devices>
Nov 15 11:16:48 user nova-compute[76049]: </domain>
Nov 15 11:16:48 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331075314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331075314',id=27,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowPv+zeh5HeWFO2gWyNt655P1rLuxk9JkH05BReuni5hPcufErhaST6j3jqwNsidl8IFiUqJYYff9h02deDf9bJZdZhCLQ4n6wIW3pKPWRiijmwQyhFNj7kfO0p7Dmsg==',key_name='tempest-keypair-1390670603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-a30rqbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG os_vif [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d9ed03b-d125-5e08-8d8c-4a7340ad0551', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-23dca063-3731-4748-a096-7788dbfc0a47 tempest-VolumesSnapshotTestJSON-753677889 tempest-VolumesSnapshotTestJSON-753677889-project-member] Lock "a4313390-b944-4fb4-880f-9868d6932977" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.906s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3681d118-30, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3681d118-30, col_values=(('qos', UUID('09ced5ec-f11c-412b-b104-155af25736bb')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3681d118-30, col_values=(('external_ids', {'iface-id': '3681d118-3073-4666-bcc9-39f1b4b7694f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:4e:e7', 'vm-uuid': '644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:48 user nova-compute[76049]: INFO os_vif [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30')
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No VIF found with MAC fa:16:3e:af:4e:e7, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.neutron [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updated VIF entry in instance network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:16:48 user nova-compute[76049]: DEBUG nova.network.neutron [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:16:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-33e79735-c70c-473f-893f-d674b855a06c req-ec1db938-4e7c-4f64-ade0-9405d270f4f6 service nova] Releasing lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-5453f11c-827f-4806-bb23-0fb0bd5f3525 req-4079940b-2a1d-4029-960e-4f2612b6ac75 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5453f11c-827f-4806-bb23-0fb0bd5f3525 req-4079940b-2a1d-4029-960e-4f2612b6ac75 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5453f11c-827f-4806-bb23-0fb0bd5f3525 req-4079940b-2a1d-4029-960e-4f2612b6ac75 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5453f11c-827f-4806-bb23-0fb0bd5f3525 req-4079940b-2a1d-4029-960e-4f2612b6ac75 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-5453f11c-827f-4806-bb23-0fb0bd5f3525 req-4079940b-2a1d-4029-960e-4f2612b6ac75 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:50 user nova-compute[76049]: WARNING nova.compute.manager [req-5453f11c-827f-4806-bb23-0fb0bd5f3525 req-4079940b-2a1d-4029-960e-4f2612b6ac75 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state building and task_state spawning.
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:16:52 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance spawned successfully.
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:16:52 user nova-compute[76049]: INFO nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-8191786c-a349-4ffa-ba93-9c79a9664ab9 req-13db0dc0-9b02-4975-8de5-d81adc358e08 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8191786c-a349-4ffa-ba93-9c79a9664ab9 req-13db0dc0-9b02-4975-8de5-d81adc358e08 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8191786c-a349-4ffa-ba93-9c79a9664ab9 req-13db0dc0-9b02-4975-8de5-d81adc358e08 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8191786c-a349-4ffa-ba93-9c79a9664ab9 req-13db0dc0-9b02-4975-8de5-d81adc358e08 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-8191786c-a349-4ffa-ba93-9c79a9664ab9 req-13db0dc0-9b02-4975-8de5-d81adc358e08 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:16:52 user nova-compute[76049]: WARNING nova.compute.manager [req-8191786c-a349-4ffa-ba93-9c79a9664ab9 req-13db0dc0-9b02-4975-8de5-d81adc358e08 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state building and task_state spawning.
Nov 15 11:16:52 user nova-compute[76049]: INFO nova.compute.manager [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Took 7.09 seconds to build instance.
Nov 15 11:16:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-574b0fe5-6d22-4afe-aec6-bd8f0d8001e8 tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.218s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:16:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:16:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:00 user nova-compute[76049]: INFO nova.compute.manager [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Terminating instance
Nov 15 11:17:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-61bfcadb-eeb3-4bf7-ad4a-766bd2130569 req-3c3e8050-5361-4a77-baeb-f77ff9af8175 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-vif-unplugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-61bfcadb-eeb3-4bf7-ad4a-766bd2130569 req-3c3e8050-5361-4a77-baeb-f77ff9af8175 service nova] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-61bfcadb-eeb3-4bf7-ad4a-766bd2130569 req-3c3e8050-5361-4a77-baeb-f77ff9af8175 service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-61bfcadb-eeb3-4bf7-ad4a-766bd2130569 req-3c3e8050-5361-4a77-baeb-f77ff9af8175 service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-61bfcadb-eeb3-4bf7-ad4a-766bd2130569 req-3c3e8050-5361-4a77-baeb-f77ff9af8175 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] No waiting events found dispatching network-vif-unplugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-61bfcadb-eeb3-4bf7-ad4a-766bd2130569 req-3c3e8050-5361-4a77-baeb-f77ff9af8175 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-vif-unplugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:17:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Instance destroyed successfully.
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.objects.instance [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lazy-loading 'resources' on Instance uuid a127ec44-88e9-4c54-9f41-4e2b8e9f9700 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1768813040',display_name='tempest-TestVolumeSwap-server-1768813040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1768813040',id=18,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEQi5eJ+aoG28vXCbUreMXzDZrV6VSTKkdnKGqj+80uCVQ/9viU/584oNZK6rSiOIBSRfVIdTq/reuZFirht9weW4wUYJisMmCb+aXLGxeieBdrkg92/6jnFaOdzXjlXg==',key_name='tempest-keypair-1506725087',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='797846ae50ef4815be5175b94f6fc15b',ramdisk_id='',reservation_id='r-dn0lo4kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-264487762',owner_user_name='tempest-TestVolumeSwap-264487762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:13:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='795aee66df224136815061e47764558b',uuid=a127ec44-88e9-4c54-9f41-4e2b8e9f9700,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Converting VIF {"id": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "address": "fa:16:3e:92:ed:04", "network": {"id": "bd5ed087-3bed-4f9b-9f63-b5953030df1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-666465402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "797846ae50ef4815be5175b94f6fc15b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f3f3a5-d4", "ovs_interfaceid": "91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:ed:04,bridge_name='br-int',has_traffic_filtering=True,id=91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b,network=Network(bd5ed087-3bed-4f9b-9f63-b5953030df1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f3f3a5-d4') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG os_vif [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ed:04,bridge_name='br-int',has_traffic_filtering=True,id=91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b,network=Network(bd5ed087-3bed-4f9b-9f63-b5953030df1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f3f3a5-d4') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f3f3a5-d4, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c87df64-702e-4d3c-99e4-67f3e03aa1a6) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:01 user nova-compute[76049]: INFO os_vif [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ed:04,bridge_name='br-int',has_traffic_filtering=True,id=91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b,network=Network(bd5ed087-3bed-4f9b-9f63-b5953030df1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f3f3a5-d4')
Nov 15 11:17:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Deleting instance files /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700_del
Nov 15 11:17:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Deletion of /opt/stack/data/nova/instances/a127ec44-88e9-4c54-9f41-4e2b8e9f9700_del complete
Nov 15 11:17:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:01 user nova-compute[76049]: INFO nova.compute.manager [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 11:17:01 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:17:01 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:17:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:02 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:02 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Took 0.82 seconds to deallocate network for instance.
Nov 15 11:17:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:03 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Deleted allocations for instance a127ec44-88e9-4c54-9f41-4e2b8e9f9700
Nov 15 11:17:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-152f3e16-1e1b-4389-aa06-2d4e6f815cef tempest-TestVolumeSwap-264487762 tempest-TestVolumeSwap-264487762-project-member] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.385s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-06b198a4-ca36-4b17-b465-3759a6528f3b req-d0d59b7e-4964-4397-9e0e-ea3493b93490 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-06b198a4-ca36-4b17-b465-3759a6528f3b req-d0d59b7e-4964-4397-9e0e-ea3493b93490 service nova] Acquiring lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-06b198a4-ca36-4b17-b465-3759a6528f3b req-d0d59b7e-4964-4397-9e0e-ea3493b93490 service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-06b198a4-ca36-4b17-b465-3759a6528f3b req-d0d59b7e-4964-4397-9e0e-ea3493b93490 service nova] Lock "a127ec44-88e9-4c54-9f41-4e2b8e9f9700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-06b198a4-ca36-4b17-b465-3759a6528f3b req-d0d59b7e-4964-4397-9e0e-ea3493b93490 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] No waiting events found dispatching network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:03 user nova-compute[76049]: WARNING nova.compute.manager [req-06b198a4-ca36-4b17-b465-3759a6528f3b req-d0d59b7e-4964-4397-9e0e-ea3493b93490 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received unexpected event network-vif-plugged-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b for instance with vm_state deleted and task_state None.
Nov 15 11:17:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-06b198a4-ca36-4b17-b465-3759a6528f3b req-d0d59b7e-4964-4397-9e0e-ea3493b93490 service nova] [instance: a127ec44-88e9-4c54-9f41-4e2b8e9f9700] Received event network-vif-deleted-91f3f3a5-d4fd-4508-b61f-e30e68a2ec8b {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:06 user nova-compute[76049]: INFO nova.compute.manager [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Terminating instance
Nov 15 11:17:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-47800ee0-c1dd-4849-bfc4-eeaf91c26eb1 req-382f7706-2018-4a0e-bef7-0d0f7604597f service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received event network-vif-unplugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-47800ee0-c1dd-4849-bfc4-eeaf91c26eb1 req-382f7706-2018-4a0e-bef7-0d0f7604597f service nova] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-47800ee0-c1dd-4849-bfc4-eeaf91c26eb1 req-382f7706-2018-4a0e-bef7-0d0f7604597f service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-47800ee0-c1dd-4849-bfc4-eeaf91c26eb1 req-382f7706-2018-4a0e-bef7-0d0f7604597f service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-47800ee0-c1dd-4849-bfc4-eeaf91c26eb1 req-382f7706-2018-4a0e-bef7-0d0f7604597f service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] No waiting events found dispatching network-vif-unplugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-47800ee0-c1dd-4849-bfc4-eeaf91c26eb1 req-382f7706-2018-4a0e-bef7-0d0f7604597f service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received event network-vif-unplugged-74301e0f-628e-4db9-9c9e-873384361203 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:17:07 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Instance destroyed successfully.
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'resources' on Instance uuid aa3ac951-6d58-424d-87d7-0ffa2cc41638 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:15:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2040530325',display_name='tempest-TestVolumeBootPattern-server-2040530325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2040530325',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:15:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-4j1ugt40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:15:32Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=aa3ac951-6d58-424d-87d7-0ffa2cc41638,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "74301e0f-628e-4db9-9c9e-873384361203", "address": "fa:16:3e:57:bd:ed", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74301e0f-62", "ovs_interfaceid": "74301e0f-628e-4db9-9c9e-873384361203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:bd:ed,bridge_name='br-int',has_traffic_filtering=True,id=74301e0f-628e-4db9-9c9e-873384361203,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74301e0f-62') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_vif [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:bd:ed,bridge_name='br-int',has_traffic_filtering=True,id=74301e0f-628e-4db9-9c9e-873384361203,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74301e0f-62') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74301e0f-62, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45ce2103-722f-4f04-bea9-1754f3138a39) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:07 user nova-compute[76049]: INFO os_vif [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:bd:ed,bridge_name='br-int',has_traffic_filtering=True,id=74301e0f-628e-4db9-9c9e-873384361203,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74301e0f-62')
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eluhgzxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:17:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc9ee2-7f8f-4e4c-92a6-7db5c2f10d2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:17:07 user nova-compute[76049]: No targets found.
Nov 15 11:17:07 user nova-compute[76049]: iSNS:
Nov 15 11:17:07 user nova-compute[76049]: No targets found.
Nov 15 11:17:07 user nova-compute[76049]: STATIC:
Nov 15 11:17:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:17:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:17:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:17:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:17:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:17:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:17:07 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a
Nov 15 11:17:07 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:17:07 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:17:07 user nova-compute[76049]: FIRMWARE:
Nov 15 11:17:07 user nova-compute[76049]: No targets found.
Nov 15 11:17:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:17:07 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:17:07 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc9b58-80d3-48c2-b4ea-e531012bb892]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619c76d-a6d0-4606-8633-8791d51b4ab2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:17:07 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:17:07 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:17:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a (non-flash)
Nov 15 11:17:07 user nova-compute[76049]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:17:07 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:17:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f628429ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c10f4e-896a-46a6-aa37-5d7d33fa1594]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[462751b9-065c-4448-9cca-648c04085c98]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c643b4-b029-4aa9-a74e-8bbbeb6be817]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ab2846-3631-4741-98da-11f9b1a8d6a3]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26136646532623865', '/dev/disk/by-id/scsi-1SCST_BIO200e0e14-a6de2b8e3a3180f4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_200e0e14') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad43cc2d-6fc5-4545-93c9-35b9d454aed5]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[866ae5ab-f11c-453e-91e7-797236fbeff3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c61180-2102-45f9-856f-472cb01d20b7]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260]
Nov 15 11:17:07 user nova-compute[76049]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a, portal: 172.16.0.220,3260] successful.
Nov 15 11:17:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fce661-d341-404b-9289-fff6464a496a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b8a090-0694-496d-9bb3-0f1b0225d69c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== disconnect_volume: return (341ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:17:07 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Deleting instance files /opt/stack/data/nova/instances/aa3ac951-6d58-424d-87d7-0ffa2cc41638_del
Nov 15 11:17:07 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Deletion of /opt/stack/data/nova/instances/aa3ac951-6d58-424d-87d7-0ffa2cc41638_del complete
Nov 15 11:17:07 user nova-compute[76049]: INFO nova.compute.manager [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 11:17:07 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:17:07 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:17:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:08 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-aa85d809-c7f1-418e-99a0-1d19e2c12041 req-3f33f779-68d8-4fa9-9b6c-c805e5f13694 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received event network-vif-deleted-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:08 user nova-compute[76049]: INFO nova.compute.manager [req-aa85d809-c7f1-418e-99a0-1d19e2c12041 req-3f33f779-68d8-4fa9-9b6c-c805e5f13694 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Neutron deleted interface 74301e0f-628e-4db9-9c9e-873384361203; detaching it from the instance and deleting it from the info cache
Nov 15 11:17:08 user nova-compute[76049]: DEBUG nova.network.neutron [req-aa85d809-c7f1-418e-99a0-1d19e2c12041 req-3f33f779-68d8-4fa9-9b6c-c805e5f13694 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:08 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Took 1.15 seconds to deallocate network for instance.
Nov 15 11:17:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-aa85d809-c7f1-418e-99a0-1d19e2c12041 req-3f33f779-68d8-4fa9-9b6c-c805e5f13694 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Detach interface failed, port_id=74301e0f-628e-4db9-9c9e-873384361203, reason: Instance aa3ac951-6d58-424d-87d7-0ffa2cc41638 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:17:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-ff6e1f81-4718-4163-956e-8bdc70935f33 req-5626b8bb-4f28-403f-832b-babdff934916 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received event network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ff6e1f81-4718-4163-956e-8bdc70935f33 req-5626b8bb-4f28-403f-832b-babdff934916 service nova] Acquiring lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ff6e1f81-4718-4163-956e-8bdc70935f33 req-5626b8bb-4f28-403f-832b-babdff934916 service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ff6e1f81-4718-4163-956e-8bdc70935f33 req-5626b8bb-4f28-403f-832b-babdff934916 service nova] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-ff6e1f81-4718-4163-956e-8bdc70935f33 req-5626b8bb-4f28-403f-832b-babdff934916 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] No waiting events found dispatching network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:09 user nova-compute[76049]: WARNING nova.compute.manager [req-ff6e1f81-4718-4163-956e-8bdc70935f33 req-5626b8bb-4f28-403f-832b-babdff934916 service nova] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Received unexpected event network-vif-plugged-74301e0f-628e-4db9-9c9e-873384361203 for instance with vm_state active and task_state deleting.
Nov 15 11:17:09 user nova-compute[76049]: INFO nova.compute.manager [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Took 0.86 seconds to detach 1 volumes for instance.
Nov 15 11:17:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: aa3ac951-6d58-424d-87d7-0ffa2cc41638] Deleting volume: c9fce661-d341-404b-9289-fff6464a496a {{(pid=76049) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 11:17:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:10 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:17:10 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:17:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:10 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Deleted allocations for instance aa3ac951-6d58-424d-87d7-0ffa2cc41638
Nov 15 11:17:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b12b8700-044f-42eb-9530-74a3c696ee53 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "aa3ac951-6d58-424d-87d7-0ffa2cc41638" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.848s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:17:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:11 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:17:11 user nova-compute[76049]: INFO nova.compute.claims [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Claim successful on node user
Nov 15 11:17:12 user nova-compute[76049]: INFO nova.compute.manager [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Rescuing
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:17:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.policy [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be68e6cecbdf4b4bac53b63914451334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8954bff85c4e23bbbd4e145b3c9f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating instance_info_cache with network_info: [{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:17:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Creating image(s)
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "/opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "/opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk 1073741824" returned: 0 in 0.052s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-63ce4176-8a71-4fc7-b69e-2b6413de81aa req-0f1a6a35-0117-483c-95fc-e0e560eef34e service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-63ce4176-8a71-4fc7-b69e-2b6413de81aa req-0f1a6a35-0117-483c-95fc-e0e560eef34e service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-63ce4176-8a71-4fc7-b69e-2b6413de81aa req-0f1a6a35-0117-483c-95fc-e0e560eef34e service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-63ce4176-8a71-4fc7-b69e-2b6413de81aa req-0f1a6a35-0117-483c-95fc-e0e560eef34e service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-63ce4176-8a71-4fc7-b69e-2b6413de81aa req-0f1a6a35-0117-483c-95fc-e0e560eef34e service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:13 user nova-compute[76049]: WARNING nova.compute.manager [req-63ce4176-8a71-4fc7-b69e-2b6413de81aa req-0f1a6a35-0117-483c-95fc-e0e560eef34e service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state active and task_state rescuing.
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.203s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Successfully created port: 3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Cannot resize image /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Ensure instance console log exists: /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance destroyed successfully.
Nov 15 11:17:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Attempting a stable device rescue
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76049) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:17:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Creating image(s)
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "/opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "266d207a7dbbf48ab5f88106a3e09b4cd3334573" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "266d207a7dbbf48ab5f88106a3e09b4cd3334573" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Successfully updated port: 3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquired lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.part --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG nova.virt.images [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] 8db4c08a-e42c-4ad6-95b3-aad0faa6d119 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:17:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.part /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updating instance_info_cache with network_info: [{"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Releasing lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Instance network_info: |[{"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Start _get_guest_xml network_info=[{"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:17:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-254339762',display_name='tempest-TestServerVolumeAttachmentScenario-server-254339762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-254339762',id=28,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQd+lR3WRIGTuVmueQOcuovXMsCwypF9p/nCG8ukJ4IHTTQdvPK/2gHU5rM4CfD/KiWtRKWEUW7uYySYi/hTjm9RjsEuMRhldNkdriSdHGKwkVcslVUHpL5a+zNz45NDg==',key_name='tempest-keypair-1138407128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8954bff85c4e23bbbd4e145b3c9f66',ramdisk_id='',reservation_id='r-35s5c2b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1692254182',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1692254182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be68e6cecbdf4b4bac53b63914451334',uuid=fe8b1a44-b45b-454f-bfdc-78dd9fea5706,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Converting VIF {"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:bb:29,bridge_name='br-int',has_traffic_filtering=True,id=3a61161e-500e-48da-bd40-d35b8b88a4f7,network=Network(d052483f-4f99-4794-af16-adcb47e6da14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a61161e-50') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'pci_devices' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:15 user nova-compute[76049]: WARNING nova.compute.manager [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state active and task_state rescuing.
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-changed-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Refreshing instance network info cache due to event network-changed-3a61161e-500e-48da-bd40-d35b8b88a4f7. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] Acquiring lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] Acquired lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Refreshing network info cache for port 3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:17:15 user nova-compute[76049]:   <uuid>fe8b1a44-b45b-454f-bfdc-78dd9fea5706</uuid>
Nov 15 11:17:15 user nova-compute[76049]:   <name>instance-0000001c</name>
Nov 15 11:17:15 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:17:15 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:17:15 user nova-compute[76049]:   <metadata>
Nov 15 11:17:15 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:17:15 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:17:15 user nova-compute[76049]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-254339762</nova:name>
Nov 15 11:17:15 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:17:15</nova:creationTime>
Nov 15 11:17:15 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:17:15 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:17:15 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:17:15 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:17:15 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:17:15 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:17:15 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:17:15 user nova-compute[76049]:       <nova:owner>
Nov 15 11:17:15 user nova-compute[76049]:         <nova:user uuid="be68e6cecbdf4b4bac53b63914451334">tempest-TestServerVolumeAttachmentScenario-1692254182-project-member</nova:user>
Nov 15 11:17:15 user nova-compute[76049]:         <nova:project uuid="2c8954bff85c4e23bbbd4e145b3c9f66">tempest-TestServerVolumeAttachmentScenario-1692254182</nova:project>
Nov 15 11:17:15 user nova-compute[76049]:       </nova:owner>
Nov 15 11:17:15 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:17:15 user nova-compute[76049]:       <nova:ports>
Nov 15 11:17:15 user nova-compute[76049]:         <nova:port uuid="3a61161e-500e-48da-bd40-d35b8b88a4f7">
Nov 15 11:17:15 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 11:17:15 user nova-compute[76049]:         </nova:port>
Nov 15 11:17:15 user nova-compute[76049]:       </nova:ports>
Nov 15 11:17:15 user nova-compute[76049]:     </nova:instance>
Nov 15 11:17:15 user nova-compute[76049]:   </metadata>
Nov 15 11:17:15 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:17:15 user nova-compute[76049]:     <system>
Nov 15 11:17:15 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:17:15 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:17:15 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:17:15 user nova-compute[76049]:       <entry name="serial">fe8b1a44-b45b-454f-bfdc-78dd9fea5706</entry>
Nov 15 11:17:15 user nova-compute[76049]:       <entry name="uuid">fe8b1a44-b45b-454f-bfdc-78dd9fea5706</entry>
Nov 15 11:17:15 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:17:15 user nova-compute[76049]:     </system>
Nov 15 11:17:15 user nova-compute[76049]:   </sysinfo>
Nov 15 11:17:15 user nova-compute[76049]:   <os>
Nov 15 11:17:15 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:17:15 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:17:15 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:17:15 user nova-compute[76049]:   </os>
Nov 15 11:17:15 user nova-compute[76049]:   <features>
Nov 15 11:17:15 user nova-compute[76049]:     <acpi/>
Nov 15 11:17:15 user nova-compute[76049]:     <apic/>
Nov 15 11:17:15 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:17:15 user nova-compute[76049]:   </features>
Nov 15 11:17:15 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:17:15 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:17:15 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:17:15 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:17:15 user nova-compute[76049]:   </clock>
Nov 15 11:17:15 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:17:15 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:17:15 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:17:15 user nova-compute[76049]:   </cpu>
Nov 15 11:17:15 user nova-compute[76049]:   <devices>
Nov 15 11:17:15 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:17:15 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:17:15 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk"/>
Nov 15 11:17:15 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:17:15 user nova-compute[76049]:     </disk>
Nov 15 11:17:15 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:17:15 user nova-compute[76049]:       <mac address="fa:16:3e:e9:bb:29"/>
Nov 15 11:17:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:17:15 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:17:15 user nova-compute[76049]:       <target dev="tap3a61161e-50"/>
Nov 15 11:17:15 user nova-compute[76049]:     </interface>
Nov 15 11:17:15 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:17:15 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/console.log" append="off"/>
Nov 15 11:17:15 user nova-compute[76049]:     </serial>
Nov 15 11:17:15 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:17:15 user nova-compute[76049]:     <video>
Nov 15 11:17:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:17:15 user nova-compute[76049]:     </video>
Nov 15 11:17:15 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:17:15 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:17:15 user nova-compute[76049]:     </rng>
Nov 15 11:17:15 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:17:15 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:17:15 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:17:15 user nova-compute[76049]:     </memballoon>
Nov 15 11:17:15 user nova-compute[76049]:   </devices>
Nov 15 11:17:15 user nova-compute[76049]: </domain>
Nov 15 11:17:15 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-254339762',display_name='tempest-TestServerVolumeAttachmentScenario-server-254339762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-254339762',id=28,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQd+lR3WRIGTuVmueQOcuovXMsCwypF9p/nCG8ukJ4IHTTQdvPK/2gHU5rM4CfD/KiWtRKWEUW7uYySYi/hTjm9RjsEuMRhldNkdriSdHGKwkVcslVUHpL5a+zNz45NDg==',key_name='tempest-keypair-1138407128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8954bff85c4e23bbbd4e145b3c9f66',ramdisk_id='',reservation_id='r-35s5c2b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1692254182',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1692254182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be68e6cecbdf4b4bac53b63914451334',uuid=fe8b1a44-b45b-454f-bfdc-78dd9fea5706,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Converting VIF {"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:bb:29,bridge_name='br-int',has_traffic_filtering=True,id=3a61161e-500e-48da-bd40-d35b8b88a4f7,network=Network(d052483f-4f99-4794-af16-adcb47e6da14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a61161e-50') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG os_vif [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:bb:29,bridge_name='br-int',has_traffic_filtering=True,id=3a61161e-500e-48da-bd40-d35b8b88a4f7,network=Network(d052483f-4f99-4794-af16-adcb47e6da14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a61161e-50') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd100e025-e4cf-5cf8-843b-a2af2e0494b3', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a61161e-50, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a61161e-50, col_values=(('qos', UUID('4164d498-990e-4318-9ad1-a00136ad82a4')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a61161e-50, col_values=(('external_ids', {'iface-id': '3a61161e-500e-48da-bd40-d35b8b88a4f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:bb:29', 'vm-uuid': 'fe8b1a44-b45b-454f-bfdc-78dd9fea5706'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:15 user nova-compute[76049]: INFO os_vif [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:bb:29,bridge_name='br-int',has_traffic_filtering=True,id=3a61161e-500e-48da-bd40-d35b8b88a4f7,network=Network(d052483f-4f99-4794-af16-adcb47e6da14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a61161e-50')
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.part /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.converted" returned: 0 in 0.620s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No VIF found with MAC fa:16:3e:e9:bb:29, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "266d207a7dbbf48ab5f88106a3e09b4cd3334573" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.068s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "266d207a7dbbf48ab5f88106a3e09b4cd3334573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "266d207a7dbbf48ab5f88106a3e09b4cd3334573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updated VIF entry in instance network info cache for port 3a61161e-500e-48da-bd40-d35b8b88a4f7. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updating instance_info_cache with network_info: [{"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b336622-3463-4fbd-bfae-ffab4620b8b5 req-83ce3bf3-004f-4e2b-beb9-fb0de078b923 service nova] Releasing lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573 --force-share --output=json" returned: 0 in 0.192s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573,backing_fmt=raw /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573,backing_fmt=raw /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue" returned: 0 in 0.050s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "266d207a7dbbf48ab5f88106a3e09b4cd3334573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'migration_context' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<8697e4ed-461e-4544-8137-faf180d111be> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Start _get_guest_xml network_info=[{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "vif_mac": "fa:16:3e:7a:32:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8db4c08a-e42c-4ad6-95b3-aad0faa6d119', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUPLSYyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8697e4ed-461e-4544-8137-faf180d111be', 'attached_at': '', 'detached_at': '', 'volume_id': '57f1c736-d603-4f9c-97da-630cc3e0f18c', 'serial': '57f1c736-d603-4f9c-97da-630cc3e0f18c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'bf8aa130-624c-4ced-a835-eb2d52e076e1', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'resources' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<8697e4ed-461e-4544-8137-faf180d111be> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'numa_topology' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<8697e4ed-461e-4544-8137-faf180d111be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:17:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:15 user nova-compute[76049]: DEBUG nova.objects.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<8697e4ed-461e-4544-8137-faf180d111be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUPLSYyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:17:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:17:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:17:16 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff664f5-e40f-439e-84b1-846216990c2d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HUPLSYyh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 11:17:16 user nova-compute[76049]: node.name = iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:17:16 user nova-compute[76049]: node.tpgt = -1
Nov 15 11:17:16 user nova-compute[76049]: node.startup = automatic
Nov 15 11:17:16 user nova-compute[76049]: node.leading_login = No
Nov 15 11:17:16 user nova-compute[76049]: iface.iscsi_ifacename = default
Nov 15 11:17:16 user nova-compute[76049]: iface.net_ifacename = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.ipaddress = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.prefix_len = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.hwaddress = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.transport_name = tcp
Nov 15 11:17:16 user nova-compute[76049]: iface.initiatorname = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.state = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.vlan_id = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.vlan_priority = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.vlan_state = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.iface_num = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.mtu = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.port = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.bootproto = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.subnet_mask = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.gateway = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_alt_client_id = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_dns = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_learn_iqn = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_vendor_id_state = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_vendor_id = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.dhcp_slp_da = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.fragmentation = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.gratuitous_arp = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.incoming_forwarding = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.tos_state = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.tos = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.ttl = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.delayed_ack = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.tcp_nagle = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.tcp_wsf_state = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.tcp_wsf = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.tcp_timer_scale = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.tcp_timestamp = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.redirect = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.def_task_mgmt_timeout = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.header_digest = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.data_digest = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.immediate_data = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.initial_r2t = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.data_seq_inorder = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.data_pdu_inorder = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.erl = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.max_receive_data_len = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.first_burst_len = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.max_outstanding_r2t = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.max_burst_len = 0
Nov 15 11:17:16 user nova-compute[76049]: iface.chap_auth = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.bidi_chap = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.strict_login_compliance = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.discovery_auth = <empty>
Nov 15 11:17:16 user nova-compute[76049]: iface.discovery_logout = <empty>
Nov 15 11:17:16 user nova-compute[76049]: node.discovery_address = <empty>
Nov 15 11:17:16 user nova-compute[76049]: node.discovery_port = 0
Nov 15 11:17:16 user nova-compute[76049]: node.discovery_type = static
Nov 15 11:17:16 user nova-compute[76049]: node.session.initial_cmdsn = 0
Nov 15 11:17:16 user nova-compute[76049]: node.session.initial_login_retry_max = 8
Nov 15 11:17:16 user nova-compute[76049]: node.session.xmit_thread_priority = -20
Nov 15 11:17:16 user nova-compute[76049]: node.session.cmds_max = 128
Nov 15 11:17:16 user nova-compute[76049]: node.session.queue_depth = 32
Nov 15 11:17:16 user nova-compute[76049]: node.session.nr_sessions = 1
Nov 15 11:17:16 user nova-compute[76049]: node.session.auth.authmethod = CHAP
Nov 15 11:17:16 user nova-compute[76049]: node.session.auth.username = HUPLSYyh
Nov 15 11:17:16 user nova-compute[76049]: node.session.auth.password = ***
Nov 15 11:17:16 user nova-compute[76049]: node.session.auth.username_in = <empty>
Nov 15 11:17:16 user nova-compute[76049]: node.session.auth.password_in = <empty>
Nov 15 11:17:16 user nova-compute[76049]: node.session.auth.chap_algs = MD5
Nov 15 11:17:16 user nova-compute[76049]: node.session.timeo.replacement_timeout = 120
Nov 15 11:17:16 user nova-compute[76049]: node.session.err_timeo.abort_timeout = 15
Nov 15 11:17:16 user nova-compute[76049]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 11:17:16 user nova-compute[76049]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 11:17:16 user nova-compute[76049]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.FastAbort = Yes
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.InitialR2T = No
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.ImmediateData = Yes
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.MaxConnections = 1
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 11:17:16 user nova-compute[76049]: node.session.iscsi.ERL = 0
Nov 15 11:17:16 user nova-compute[76049]: node.session.scan = manual
Nov 15 11:17:16 user nova-compute[76049]: node.session.reopen_max = 0
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].address = 172.16.0.220
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].port = 3260
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].startup = manual
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].tcp.window_size = 524288
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].tcp.type_of_service = 0
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].timeo.logout_timeout = 15
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].timeo.login_timeout = 15
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].timeo.auth_timeout = 45
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].iscsi.DataDigest = None
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].iscsi.IFMarker = No
Nov 15 11:17:16 user nova-compute[76049]: node.conn[0].iscsi.OFMarker = No
Nov 15 11:17:16 user nova-compute[76049]: # END RECORD
Nov 15 11:17:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4f3009-3445-464f-b1a7-025fa6b9a4ee]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7d1ce2-7a47-49da-b6a5-b814badac39c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUPLSYyh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUPLSYyh" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8132bf8b-34a5-4c16-9674-958512110b0c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUPLSYyh'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7801990d-895c-4fd0-97eb-f6bd792840b3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2541475a-ad29-4457-9253-77244c7eb0e3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:17:16 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:17:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:17:16 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:17:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] HCTL ('35', '0', '0', 0) found on session 21 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f101d964-101b-46f9-8308-1b6a9215f83e]: (4, ('0 0 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching for a device in session 21 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUPLSYyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== connect_volume: return (172ms) {'type': 'block', 'scsi_wwn': '26136386337633962', 'path': '/dev/sdd'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136386337633962', 'path': '/dev/sdd'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033587775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033587775',id=24,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:15:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-05c01rg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:15:38Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=8697e4ed-461e-4544-8137-faf180d111be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "vif_mac": "fa:16:3e:7a:32:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "vif_mac": "fa:16:3e:7a:32:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'pci_devices' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.objects.base [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<8697e4ed-461e-4544-8137-faf180d111be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:17:16 user nova-compute[76049]:   <uuid>8697e4ed-461e-4544-8137-faf180d111be</uuid>
Nov 15 11:17:16 user nova-compute[76049]:   <name>instance-00000018</name>
Nov 15 11:17:16 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:17:16 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:17:16 user nova-compute[76049]:   <metadata>
Nov 15 11:17:16 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:17:16 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:17:16 user nova-compute[76049]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2033587775</nova:name>
Nov 15 11:17:16 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:17:15</nova:creationTime>
Nov 15 11:17:16 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:17:16 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:17:16 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:17:16 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:17:16 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:17:16 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:17:16 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:17:16 user nova-compute[76049]:       <nova:owner>
Nov 15 11:17:16 user nova-compute[76049]:         <nova:user uuid="81bd63b00a9c4f8983e335cf898f77ad">tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member</nova:user>
Nov 15 11:17:16 user nova-compute[76049]:         <nova:project uuid="25a9fe3c211d4bb78b9c6878147a9c75">tempest-ServerBootFromVolumeStableRescueTest-1027868851</nova:project>
Nov 15 11:17:16 user nova-compute[76049]:       </nova:owner>
Nov 15 11:17:16 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:17:16 user nova-compute[76049]:       <nova:ports>
Nov 15 11:17:16 user nova-compute[76049]:         <nova:port uuid="4ec20e73-a139-4cb2-82ac-524d080ad9e9">
Nov 15 11:17:16 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 11:17:16 user nova-compute[76049]:         </nova:port>
Nov 15 11:17:16 user nova-compute[76049]:       </nova:ports>
Nov 15 11:17:16 user nova-compute[76049]:     </nova:instance>
Nov 15 11:17:16 user nova-compute[76049]:   </metadata>
Nov 15 11:17:16 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:17:16 user nova-compute[76049]:     <system>
Nov 15 11:17:16 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:17:16 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:17:16 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:17:16 user nova-compute[76049]:       <entry name="serial">8697e4ed-461e-4544-8137-faf180d111be</entry>
Nov 15 11:17:16 user nova-compute[76049]:       <entry name="uuid">8697e4ed-461e-4544-8137-faf180d111be</entry>
Nov 15 11:17:16 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:17:16 user nova-compute[76049]:     </system>
Nov 15 11:17:16 user nova-compute[76049]:   </sysinfo>
Nov 15 11:17:16 user nova-compute[76049]:   <os>
Nov 15 11:17:16 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:17:16 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:17:16 user nova-compute[76049]:   </os>
Nov 15 11:17:16 user nova-compute[76049]:   <features>
Nov 15 11:17:16 user nova-compute[76049]:     <acpi/>
Nov 15 11:17:16 user nova-compute[76049]:     <apic/>
Nov 15 11:17:16 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:17:16 user nova-compute[76049]:   </features>
Nov 15 11:17:16 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:17:16 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:17:16 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:17:16 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:17:16 user nova-compute[76049]:   </clock>
Nov 15 11:17:16 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:17:16 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:17:16 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:17:16 user nova-compute[76049]:   </cpu>
Nov 15 11:17:16 user nova-compute[76049]:   <devices>
Nov 15 11:17:16 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:17:16 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:17:16 user nova-compute[76049]:       <source dev="/dev/sdd"/>
Nov 15 11:17:16 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:17:16 user nova-compute[76049]:       <serial>57f1c736-d603-4f9c-97da-630cc3e0f18c</serial>
Nov 15 11:17:16 user nova-compute[76049]:     </disk>
Nov 15 11:17:16 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:17:16 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:17:16 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue"/>
Nov 15 11:17:16 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:17:16 user nova-compute[76049]:       <boot order="1"/>
Nov 15 11:17:16 user nova-compute[76049]:     </disk>
Nov 15 11:17:16 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:17:16 user nova-compute[76049]:       <mac address="fa:16:3e:7a:32:13"/>
Nov 15 11:17:16 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:17:16 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:17:16 user nova-compute[76049]:       <target dev="tap4ec20e73-a1"/>
Nov 15 11:17:16 user nova-compute[76049]:     </interface>
Nov 15 11:17:16 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:17:16 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/console.log" append="off"/>
Nov 15 11:17:16 user nova-compute[76049]:     </serial>
Nov 15 11:17:16 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:17:16 user nova-compute[76049]:     <video>
Nov 15 11:17:16 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:17:16 user nova-compute[76049]:     </video>
Nov 15 11:17:16 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:17:16 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:17:16 user nova-compute[76049]:     </rng>
Nov 15 11:17:16 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:17:16 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:17:16 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:17:16 user nova-compute[76049]:     </memballoon>
Nov 15 11:17:16 user nova-compute[76049]:   </devices>
Nov 15 11:17:16 user nova-compute[76049]: </domain>
Nov 15 11:17:16 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:17:16 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance destroyed successfully.
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:17:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No VIF found with MAC fa:16:3e:7a:32:13, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-5ea8b16b-be89-45ad-a79d-2a4c293417cf req-7d76dc99-a922-4da4-8505-a886ed13e23f service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5ea8b16b-be89-45ad-a79d-2a4c293417cf req-7d76dc99-a922-4da4-8505-a886ed13e23f service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5ea8b16b-be89-45ad-a79d-2a4c293417cf req-7d76dc99-a922-4da4-8505-a886ed13e23f service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5ea8b16b-be89-45ad-a79d-2a4c293417cf req-7d76dc99-a922-4da4-8505-a886ed13e23f service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-5ea8b16b-be89-45ad-a79d-2a4c293417cf req-7d76dc99-a922-4da4-8505-a886ed13e23f service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:17 user nova-compute[76049]: WARNING nova.compute.manager [req-5ea8b16b-be89-45ad-a79d-2a4c293417cf req-7d76dc99-a922-4da4-8505-a886ed13e23f service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received unexpected event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with vm_state building and task_state spawning.
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-1fbb69b0-cfc1-4627-a2d3-c5c31c9119fe req-274eb125-6a2e-442e-b773-a9200f8b976c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1fbb69b0-cfc1-4627-a2d3-c5c31c9119fe req-274eb125-6a2e-442e-b773-a9200f8b976c service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1fbb69b0-cfc1-4627-a2d3-c5c31c9119fe req-274eb125-6a2e-442e-b773-a9200f8b976c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1fbb69b0-cfc1-4627-a2d3-c5c31c9119fe req-274eb125-6a2e-442e-b773-a9200f8b976c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-1fbb69b0-cfc1-4627-a2d3-c5c31c9119fe req-274eb125-6a2e-442e-b773-a9200f8b976c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:18 user nova-compute[76049]: WARNING nova.compute.manager [req-1fbb69b0-cfc1-4627-a2d3-c5c31c9119fe req-274eb125-6a2e-442e-b773-a9200f8b976c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state active and task_state rescuing.
Nov 15 11:17:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-9e0ec54c-470b-4fa0-8017-70d9e12d77fe req-f3ab0d32-83cb-4c9a-8601-b998b75582d5 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9e0ec54c-470b-4fa0-8017-70d9e12d77fe req-f3ab0d32-83cb-4c9a-8601-b998b75582d5 service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9e0ec54c-470b-4fa0-8017-70d9e12d77fe req-f3ab0d32-83cb-4c9a-8601-b998b75582d5 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9e0ec54c-470b-4fa0-8017-70d9e12d77fe req-f3ab0d32-83cb-4c9a-8601-b998b75582d5 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-9e0ec54c-470b-4fa0-8017-70d9e12d77fe req-f3ab0d32-83cb-4c9a-8601-b998b75582d5 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:19 user nova-compute[76049]: WARNING nova.compute.manager [req-9e0ec54c-470b-4fa0-8017-70d9e12d77fe req-f3ab0d32-83cb-4c9a-8601-b998b75582d5 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received unexpected event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with vm_state building and task_state spawning.
Nov 15 11:17:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:17:19 user nova-compute[76049]: INFO nova.compute.claims [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Claim successful on node user
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:17:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.policy [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c548eac583644342a905b89ee8fc4b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61718ae918a495eadf79664d2ea66c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:17:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Creating image(s)
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.194s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk 1073741824" returned: 0 in 0.112s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:17:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Instance spawned successfully.
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-34c5573a-244f-4ebe-bdc2-8bcc07fd69a3 req-0f6cd8c9-f065-4f36-8f75-383795b08e9c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-34c5573a-244f-4ebe-bdc2-8bcc07fd69a3 req-0f6cd8c9-f065-4f36-8f75-383795b08e9c service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-34c5573a-244f-4ebe-bdc2-8bcc07fd69a3 req-0f6cd8c9-f065-4f36-8f75-383795b08e9c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-34c5573a-244f-4ebe-bdc2-8bcc07fd69a3 req-0f6cd8c9-f065-4f36-8f75-383795b08e9c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-34c5573a-244f-4ebe-bdc2-8bcc07fd69a3 req-0f6cd8c9-f065-4f36-8f75-383795b08e9c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:20 user nova-compute[76049]: WARNING nova.compute.manager [req-34c5573a-244f-4ebe-bdc2-8bcc07fd69a3 req-0f6cd8c9-f065-4f36-8f75-383795b08e9c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state active and task_state rescuing.
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:17:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:21 user nova-compute[76049]: INFO nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Took 8.48 seconds to spawn the instance on the hypervisor.
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c5c045d6-0a0d-4cc2-93fb-6b64d2d1b323 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Cannot resize image /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Ensure instance console log exists: /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Successfully created port: 106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:17:21 user nova-compute[76049]: INFO nova.compute.manager [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Took 9.37 seconds to build instance.
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5a66841f-2a08-4a28-bcf8-9863bb2c8ce5 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.477s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Successfully updated port: 106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquired lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updating instance_info_cache with network_info: [{"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Releasing lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance network_info: |[{"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Start _get_guest_xml network_info=[{"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:17:22 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:22 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-629386612',display_name='tempest-tempest.common.compute-instance-629386612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-629386612',id=29,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdfw8Vhn8HmFUxs4uQBERoBTqPeLBl7Un+FuADAkStah/A1RlP/97OuP2PrMkPLvhz7jjAvT72k+haEZtzLpKYwmYQP/3EEIX5nmnAAZc/QHHdaPJIknGNQRE+WnywtGQ==',key_name='tempest-keypair-1985050702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-ovhgk6k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'pci_devices' on Instance uuid 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:17:22 user nova-compute[76049]:   <uuid>24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa</uuid>
Nov 15 11:17:22 user nova-compute[76049]:   <name>instance-0000001d</name>
Nov 15 11:17:22 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:17:22 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:17:22 user nova-compute[76049]:   <metadata>
Nov 15 11:17:22 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:17:22 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:17:22 user nova-compute[76049]:       <nova:name>tempest-tempest.common.compute-instance-629386612</nova:name>
Nov 15 11:17:22 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:17:22</nova:creationTime>
Nov 15 11:17:22 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:17:22 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:17:22 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:17:22 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:17:22 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:17:22 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:17:22 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:17:22 user nova-compute[76049]:       <nova:owner>
Nov 15 11:17:22 user nova-compute[76049]:         <nova:user uuid="c548eac583644342a905b89ee8fc4b1a">tempest-ServerActionsTestOtherA-278593450-project-member</nova:user>
Nov 15 11:17:22 user nova-compute[76049]:         <nova:project uuid="a61718ae918a495eadf79664d2ea66c6">tempest-ServerActionsTestOtherA-278593450</nova:project>
Nov 15 11:17:22 user nova-compute[76049]:       </nova:owner>
Nov 15 11:17:22 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:17:22 user nova-compute[76049]:       <nova:ports>
Nov 15 11:17:22 user nova-compute[76049]:         <nova:port uuid="106fa0fd-82a1-49f2-a0f8-35cc9c49ec31">
Nov 15 11:17:22 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 11:17:22 user nova-compute[76049]:         </nova:port>
Nov 15 11:17:22 user nova-compute[76049]:       </nova:ports>
Nov 15 11:17:22 user nova-compute[76049]:     </nova:instance>
Nov 15 11:17:22 user nova-compute[76049]:   </metadata>
Nov 15 11:17:22 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:17:22 user nova-compute[76049]:     <system>
Nov 15 11:17:22 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:17:22 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:17:22 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:17:22 user nova-compute[76049]:       <entry name="serial">24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa</entry>
Nov 15 11:17:22 user nova-compute[76049]:       <entry name="uuid">24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa</entry>
Nov 15 11:17:22 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:17:22 user nova-compute[76049]:     </system>
Nov 15 11:17:22 user nova-compute[76049]:   </sysinfo>
Nov 15 11:17:22 user nova-compute[76049]:   <os>
Nov 15 11:17:22 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:17:22 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:17:22 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:17:22 user nova-compute[76049]:   </os>
Nov 15 11:17:22 user nova-compute[76049]:   <features>
Nov 15 11:17:22 user nova-compute[76049]:     <acpi/>
Nov 15 11:17:22 user nova-compute[76049]:     <apic/>
Nov 15 11:17:22 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:17:22 user nova-compute[76049]:   </features>
Nov 15 11:17:22 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:17:22 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:17:22 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:17:22 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:17:22 user nova-compute[76049]:   </clock>
Nov 15 11:17:22 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:17:22 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:17:22 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:17:22 user nova-compute[76049]:   </cpu>
Nov 15 11:17:22 user nova-compute[76049]:   <devices>
Nov 15 11:17:22 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:17:22 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:17:22 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk"/>
Nov 15 11:17:22 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:17:22 user nova-compute[76049]:     </disk>
Nov 15 11:17:22 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:17:22 user nova-compute[76049]:       <mac address="fa:16:3e:67:a7:79"/>
Nov 15 11:17:22 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:17:22 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:17:22 user nova-compute[76049]:       <target dev="tap106fa0fd-82"/>
Nov 15 11:17:22 user nova-compute[76049]:     </interface>
Nov 15 11:17:22 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:17:22 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/console.log" append="off"/>
Nov 15 11:17:22 user nova-compute[76049]:     </serial>
Nov 15 11:17:22 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:17:22 user nova-compute[76049]:     <video>
Nov 15 11:17:22 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:17:22 user nova-compute[76049]:     </video>
Nov 15 11:17:22 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:17:22 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:17:22 user nova-compute[76049]:     </rng>
Nov 15 11:17:22 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:17:22 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:17:22 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:17:22 user nova-compute[76049]:     </memballoon>
Nov 15 11:17:22 user nova-compute[76049]:   </devices>
Nov 15 11:17:22 user nova-compute[76049]: </domain>
Nov 15 11:17:22 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-629386612',display_name='tempest-tempest.common.compute-instance-629386612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-629386612',id=29,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdfw8Vhn8HmFUxs4uQBERoBTqPeLBl7Un+FuADAkStah/A1RlP/97OuP2PrMkPLvhz7jjAvT72k+haEZtzLpKYwmYQP/3EEIX5nmnAAZc/QHHdaPJIknGNQRE+WnywtGQ==',key_name='tempest-keypair-1985050702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-ovhgk6k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG os_vif [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4679596-201f-5f0a-a3c2-4c7582bfb5e2', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap106fa0fd-82, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap106fa0fd-82, col_values=(('qos', UUID('9fcce4cc-05ed-4b8a-9bec-0bfac4f519e8')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap106fa0fd-82, col_values=(('external_ids', {'iface-id': '106fa0fd-82a1-49f2-a0f8-35cc9c49ec31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:a7:79', 'vm-uuid': '24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:22 user nova-compute[76049]: INFO os_vif [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82')
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:17:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No VIF found with MAC fa:16:3e:67:a7:79, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-changed-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Refreshing instance network info cache due to event network-changed-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] Acquiring lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] Acquired lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Refreshing network info cache for port 106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updated VIF entry in instance network info cache for port 106fa0fd-82a1-49f2-a0f8-35cc9c49ec31. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updating instance_info_cache with network_info: [{"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a829b16-9a04-4ec9-aecf-58947b45e24a req-53eddb26-e487-44d9-bf21-fd27338106e8 service nova] Releasing lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:17:23 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-588c6403-b7c1-4e50-ae06-5fbd292bd3a6 req-1ecbe083-4b66-4d79-8dde-8d12defb6a2d service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-588c6403-b7c1-4e50-ae06-5fbd292bd3a6 req-1ecbe083-4b66-4d79-8dde-8d12defb6a2d service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-588c6403-b7c1-4e50-ae06-5fbd292bd3a6 req-1ecbe083-4b66-4d79-8dde-8d12defb6a2d service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-588c6403-b7c1-4e50-ae06-5fbd292bd3a6 req-1ecbe083-4b66-4d79-8dde-8d12defb6a2d service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-588c6403-b7c1-4e50-ae06-5fbd292bd3a6 req-1ecbe083-4b66-4d79-8dde-8d12defb6a2d service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:24 user nova-compute[76049]: WARNING nova.compute.manager [req-588c6403-b7c1-4e50-ae06-5fbd292bd3a6 req-1ecbe083-4b66-4d79-8dde-8d12defb6a2d service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received unexpected event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with vm_state building and task_state spawning.
Nov 15 11:17:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-5791687a-27e5-4d34-82f8-ae3510218266 req-30571b26-c13a-4d40-880a-601954273151 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5791687a-27e5-4d34-82f8-ae3510218266 req-30571b26-c13a-4d40-880a-601954273151 service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5791687a-27e5-4d34-82f8-ae3510218266 req-30571b26-c13a-4d40-880a-601954273151 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5791687a-27e5-4d34-82f8-ae3510218266 req-30571b26-c13a-4d40-880a-601954273151 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-5791687a-27e5-4d34-82f8-ae3510218266 req-30571b26-c13a-4d40-880a-601954273151 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:17:26 user nova-compute[76049]: WARNING nova.compute.manager [req-5791687a-27e5-4d34-82f8-ae3510218266 req-30571b26-c13a-4d40-880a-601954273151 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received unexpected event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with vm_state building and task_state spawning.
Nov 15 11:17:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance spawned successfully.
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:17:26 user nova-compute[76049]: INFO nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 15 11:17:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:26 user nova-compute[76049]: INFO nova.compute.manager [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Took 7.30 seconds to build instance.
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d73b2300-7f12-44ab-b1fa-cbfe78851f36 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.451s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:17:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7641MB free_disk=25.239051818847656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 00bc4c99-4801-474c-85ad-13534fe75469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:17:31 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:17:32 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:17:32 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:17:32 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:17:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:17:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:17:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:00 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'flavor' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:01 user nova-compute[76049]: INFO nova.compute.manager [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Attaching volume e4871c5e-e6f8-409a-8f28-eca543a518eb to /dev/vdb
Nov 15 11:18:01 user nova-compute[76049]: DEBUG os_brick.utils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[71db3920-534b-4c76-af9a-fe8638c27532]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5381716a-6958-4656-bf04-67d3b2389b81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c451363-0f35-4064-a91e-4626c2f513c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[638b2cdd-8c5c-4c66-b08d-81140b604c99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:01 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:18:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b268b97-2931-4d46-a9a8-a220de093b91]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG os_brick.utils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:01 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating existing volume attachment record: a559b88b-1949-4ada-b979-77c841487130 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:18:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPDNBvhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:07 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f75254f-ddc8-4fc1-8b16-d18a2d15913b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:18:07 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9373f-94b3-4954-8ab9-29996dc87fb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb] added
Nov 15 11:18:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[647036d9-6965-4b1b-be16-c7979d40f95b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa2718-8865-42d2-aad0-01002aa6a00b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPDNBvhp {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPDNBvhp" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1734ab45-2dff-4c0d-80b5-1722d225f11f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPDNBvhp'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dd9138-cd0c-40fa-8379-d76ba7c0c442]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f266853c-ce6c-4c60-827b-4c62d2292241]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:07 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:07 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdb0b31-20d7-461c-934b-8d1d42340ba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260]
Nov 15 11:18:07 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee75e3-fe86-42f5-8c57-505f9c17b23c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e32188-dce1-4d42-a7c1-4c8b4c454007]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:07 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:07 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:07 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:07 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8318a-d8a5-4916-be15-1619bb39aaae]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPDNBvhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "791aeb30-373c-405b-b408-fdba0d4a3cee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:18:08 user nova-compute[76049]: INFO nova.compute.claims [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Claim successful on node user
Nov 15 11:18:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23937313133373566', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313133373566', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'flavor' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:18:08 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:18:08 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:18:08 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:18:08 user nova-compute[76049]:   <serial>e4871c5e-e6f8-409a-8f28-eca543a518eb</serial>
Nov 15 11:18:08 user nova-compute[76049]: </disk>
Nov 15 11:18:08 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:18:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No VIF found with MAC fa:16:3e:f4:ca:26, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:18:08 user nova-compute[76049]: DEBUG nova.policy [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac7d77f50629413bb7b6c9457156af67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0917737287484e2498e2dcf616b8679e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:18:08 user nova-compute[76049]: INFO nova.virt.block_device [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Booting with volume 255a1103-65e5-4bcd-8127-ea2aabbf2b10 at /dev/vda
Nov 15 11:18:09 user nova-compute[76049]: DEBUG os_brick.utils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2ec46f-18ab-4264-bbc4-6230426e728e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e3c044f-e010-441a-8e68-6d9c63eba31c tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.889s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed11c5b-7869-4849-9b09-c89e986efd95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e015cf-5519-4f4a-a86c-04362d8a90ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6a3d9-d0bf-4d9c-8b40-de33ad327403]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:09 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:18:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de0271f-2d2a-4132-8b00-f99d6f4ee39a]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG os_brick.utils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:09 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updating existing volume attachment record: 9d0e8253-3761-46b7-82f2-cc1ca5cf944b {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:10 user nova-compute[76049]: INFO nova.compute.manager [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Unshelving
Nov 15 11:18:10 user nova-compute[76049]: INFO nova.virt.block_device [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Booting with volume 13e25910-8dea-43b7-8b04-bb6b6420ecd3 at /dev/vda
Nov 15 11:18:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[408d7c30-7d72-4369-bfee-e900b3e80403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf139f3-d45f-4a54-9eb2-6d9e4ddc5cd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[accf7a68-a2b4-4f90-aa2a-abf0b8e718f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9739cb5-b743-4487-bc0d-4f6f8cc17329]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:10 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8314c4-7bed-415e-8d59-20e5834a6934]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating existing volume attachment record: a9af9e37-b83c-437a-ac7b-174bcb837691 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Successfully created port: a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:18:10 user nova-compute[76049]: INFO nova.compute.manager [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Rescuing
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Successfully updated port: a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquired lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-changed-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Refreshing instance network info cache due to event network-changed-a55c1b89-518e-4352-95c1-a69902fcda3c. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] Acquiring lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-93f0e49a-760c-425d-840c-a1a0784c553e req-40cf657e-9e8f-4fb3-9e6b-3496ed65f6ac service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-93f0e49a-760c-425d-840c-a1a0784c553e req-40cf657e-9e8f-4fb3-9e6b-3496ed65f6ac service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-93f0e49a-760c-425d-840c-a1a0784c553e req-40cf657e-9e8f-4fb3-9e6b-3496ed65f6ac service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-93f0e49a-760c-425d-840c-a1a0784c553e req-40cf657e-9e8f-4fb3-9e6b-3496ed65f6ac service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-93f0e49a-760c-425d-840c-a1a0784c553e req-40cf657e-9e8f-4fb3-9e6b-3496ed65f6ac service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:11 user nova-compute[76049]: WARNING nova.compute.manager [req-93f0e49a-760c-425d-840c-a1a0784c553e req-40cf657e-9e8f-4fb3-9e6b-3496ed65f6ac service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state active and task_state rescuing.
Nov 15 11:18:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:18:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance destroyed successfully.
Nov 15 11:18:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Attempting a stable device rescue
Nov 15 11:18:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=76049) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:18:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Creating image(s)
Nov 15 11:18:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updating instance_info_cache with network_info: [{"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Releasing lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Instance network_info: |[{"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] Acquired lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Refreshing network info cache for port a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.part --force-share --output=json" returned: 0 in 0.196s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG nova.virt.images [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] 0a3766a0-4701-4bab-840c-388680ae0712 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.part /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-fba8e51d-16be-47be-850f-c46c5e3399e7 req-73901904-5d76-40df-ab24-53582b38b3b4 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fba8e51d-16be-47be-850f-c46c5e3399e7 req-73901904-5d76-40df-ab24-53582b38b3b4 service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fba8e51d-16be-47be-850f-c46c5e3399e7 req-73901904-5d76-40df-ab24-53582b38b3b4 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fba8e51d-16be-47be-850f-c46c5e3399e7 req-73901904-5d76-40df-ab24-53582b38b3b4 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-fba8e51d-16be-47be-850f-c46c5e3399e7 req-73901904-5d76-40df-ab24-53582b38b3b4 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:13 user nova-compute[76049]: WARNING nova.compute.manager [req-fba8e51d-16be-47be-850f-c46c5e3399e7 req-73901904-5d76-40df-ab24-53582b38b3b4 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state active and task_state rescuing.
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.network.neutron [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updated VIF entry in instance network info cache for port a55c1b89-518e-4352-95c1-a69902fcda3c. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.network.neutron [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updating instance_info_cache with network_info: [{"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-20eba6bc-7ab7-4df2-9b4b-5dc88e764c0d req-0bc82f79-f942-4b65-8f86-f9422a98632b service nova] Releasing lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.part /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.converted" returned: 0 in 0.610s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.229s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97 --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97,backing_fmt=raw /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97,backing_fmt=raw /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue" returned: 0 in 0.050s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'migration_context' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Object Instance<00bc4c99-4801-474c-85ad-13534fe75469> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Start _get_guest_xml network_info=[{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "vif_mac": "fa:16:3e:f4:ca:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0a3766a0-4701-4bab-840c-388680ae0712', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPDNBvhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '00bc4c99-4801-474c-85ad-13534fe75469', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4871c5e-e6f8-409a-8f28-eca543a518eb', 'serial': 'e4871c5e-e6f8-409a-8f28-eca543a518eb'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'a559b88b-1949-4ada-b979-77c841487130', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'resources' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Object Instance<00bc4c99-4801-474c-85ad-13534fe75469> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'numa_topology' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Object Instance<00bc4c99-4801-474c-85ad-13534fe75469> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:18:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Creating image(s)
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Ensure instance console log exists: /opt/stack/data/nova/instances/791aeb30-373c-405b-b408-fdba0d4a3cee/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Start _get_guest_xml network_info=[{"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZYLEreQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '791aeb30-373c-405b-b408-fdba0d4a3cee', 'attached_at': '', 'detached_at': '', 'volume_id': '255a1103-65e5-4bcd-8127-ea2aabbf2b10', 'serial': '255a1103-65e5-4bcd-8127-ea2aabbf2b10'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '9d0e8253-3761-46b7-82f2-cc1ca5cf944b', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.objects.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Object Instance<00bc4c99-4801-474c-85ad-13534fe75469> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPDNBvhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:14 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:14 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:14 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZYLEreQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:14 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb321b39-9220-4ce4-ada0-40c5d6c82ead]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jPDNBvhp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 11:18:14 user nova-compute[76049]: node.name = iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:18:14 user nova-compute[76049]: node.tpgt = -1
Nov 15 11:18:14 user nova-compute[76049]: node.startup = automatic
Nov 15 11:18:14 user nova-compute[76049]: node.leading_login = No
Nov 15 11:18:14 user nova-compute[76049]: iface.iscsi_ifacename = default
Nov 15 11:18:14 user nova-compute[76049]: iface.net_ifacename = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.ipaddress = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.prefix_len = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.hwaddress = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.transport_name = tcp
Nov 15 11:18:14 user nova-compute[76049]: iface.initiatorname = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.state = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.vlan_id = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.vlan_priority = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.vlan_state = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.iface_num = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.mtu = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.port = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.bootproto = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.subnet_mask = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.gateway = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_alt_client_id = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_dns = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_learn_iqn = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_vendor_id_state = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_vendor_id = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.dhcp_slp_da = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.fragmentation = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.gratuitous_arp = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.incoming_forwarding = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.tos_state = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.tos = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.ttl = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.delayed_ack = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.tcp_nagle = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.tcp_wsf_state = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.tcp_wsf = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.tcp_timer_scale = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.tcp_timestamp = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.redirect = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.def_task_mgmt_timeout = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.header_digest = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.data_digest = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.immediate_data = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.initial_r2t = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.data_seq_inorder = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.data_pdu_inorder = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.erl = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.max_receive_data_len = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.first_burst_len = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.max_outstanding_r2t = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.max_burst_len = 0
Nov 15 11:18:14 user nova-compute[76049]: iface.chap_auth = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.bidi_chap = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.strict_login_compliance = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.discovery_auth = <empty>
Nov 15 11:18:14 user nova-compute[76049]: iface.discovery_logout = <empty>
Nov 15 11:18:14 user nova-compute[76049]: node.discovery_address = <empty>
Nov 15 11:18:14 user nova-compute[76049]: node.discovery_port = 0
Nov 15 11:18:14 user nova-compute[76049]: node.discovery_type = static
Nov 15 11:18:14 user nova-compute[76049]: node.session.initial_cmdsn = 0
Nov 15 11:18:14 user nova-compute[76049]: node.session.initial_login_retry_max = 8
Nov 15 11:18:14 user nova-compute[76049]: node.session.xmit_thread_priority = -20
Nov 15 11:18:14 user nova-compute[76049]: node.session.cmds_max = 128
Nov 15 11:18:14 user nova-compute[76049]: node.session.queue_depth = 32
Nov 15 11:18:14 user nova-compute[76049]: node.session.nr_sessions = 1
Nov 15 11:18:14 user nova-compute[76049]: node.session.auth.authmethod = CHAP
Nov 15 11:18:14 user nova-compute[76049]: node.session.auth.username = jPDNBvhp
Nov 15 11:18:14 user nova-compute[76049]: node.session.auth.password = ***
Nov 15 11:18:14 user nova-compute[76049]: node.session.auth.username_in = <empty>
Nov 15 11:18:14 user nova-compute[76049]: node.session.auth.password_in = <empty>
Nov 15 11:18:14 user nova-compute[76049]: node.session.auth.chap_algs = MD5
Nov 15 11:18:14 user nova-compute[76049]: node.session.timeo.replacement_timeout = 120
Nov 15 11:18:14 user nova-compute[76049]: node.session.err_timeo.abort_timeout = 15
Nov 15 11:18:14 user nova-compute[76049]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 11:18:14 user nova-compute[76049]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 11:18:14 user nova-compute[76049]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.FastAbort = Yes
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.InitialR2T = No
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.ImmediateData = Yes
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.MaxConnections = 1
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 11:18:14 user nova-compute[76049]: node.session.iscsi.ERL = 0
Nov 15 11:18:14 user nova-compute[76049]: node.session.scan = manual
Nov 15 11:18:14 user nova-compute[76049]: node.session.reopen_max = 0
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].address = 172.16.0.220
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].port = 3260
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].startup = manual
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].tcp.window_size = 524288
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].tcp.type_of_service = 0
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].timeo.logout_timeout = 15
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].timeo.login_timeout = 15
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].timeo.auth_timeout = 45
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].iscsi.DataDigest = None
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].iscsi.IFMarker = No
Nov 15 11:18:14 user nova-compute[76049]: node.conn[0].iscsi.OFMarker = No
Nov 15 11:18:14 user nova-compute[76049]: # END RECORD
Nov 15 11:18:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f16825c-07c2-412f-989c-424354c2f290]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff14a1-fecc-48ef-be31-22bbb2ab2ab4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPDNBvhp {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPDNBvhp" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[730a66d6-85e7-45b0-a9ac-093f9e9ec95f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPDNBvhp'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697e7d0-d827-4620-bbfc-51006217c0e1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2548c93-e579-4515-bc6d-2d5d929f35d2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:14 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:14 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:14 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:14 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:18:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[782c8206-86d7-41f3-9d1a-694676aae28a]: (4, ('0 0 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPDNBvhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.203s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] <== connect_volume: return (205ms) {'type': 'block', 'scsi_wwn': '23937313133373566', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313133373566', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.160s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:15 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:15 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1539619791',display_name='tempest-ServerStableDeviceRescueTest-server-1539619791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1539619791',id=20,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5YJ6b2hQTaoK1rprHOO7ah8cYXA9w5jrVcvFmaVX8faQX1l0vcPy31SLLQHA4MWR+Rd3TzxheoN+k2VY5atuSZjVgz+xwoPtwSMUOjzv+PcGV1X5IbQVwo3pdCvohqmQ==',key_name='tempest-keypair-62701307',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f28351c85da4988a1f942d5948be8c2',ramdisk_id='',reservation_id='r-vi4h98mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1167147547',owner_user_name='tempest-ServerStableDeviceRescueTest-1167147547-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dbaf60d380d45e8844a85b0064ed9c3',uuid=00bc4c99-4801-474c-85ad-13534fe75469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "vif_mac": "fa:16:3e:f4:ca:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converting VIF {"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "vif_mac": "fa:16:3e:f4:ca:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'pci_devices' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5973e955-2d6f-4f6d-a0a3-9b720341f09c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:18:15 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.objects.base [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Object Instance<00bc4c99-4801-474c-85ad-13534fe75469> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:18:15 user nova-compute[76049]:   <uuid>00bc4c99-4801-474c-85ad-13534fe75469</uuid>
Nov 15 11:18:15 user nova-compute[76049]:   <name>instance-00000014</name>
Nov 15 11:18:15 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:18:15 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:18:15 user nova-compute[76049]:   <metadata>
Nov 15 11:18:15 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:18:15 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:18:15 user nova-compute[76049]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1539619791</nova:name>
Nov 15 11:18:15 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:18:14</nova:creationTime>
Nov 15 11:18:15 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:18:15 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:18:15 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:18:15 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:18:15 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:18:15 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:18:15 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:18:15 user nova-compute[76049]:       <nova:owner>
Nov 15 11:18:15 user nova-compute[76049]:         <nova:user uuid="8dbaf60d380d45e8844a85b0064ed9c3">tempest-ServerStableDeviceRescueTest-1167147547-project-member</nova:user>
Nov 15 11:18:15 user nova-compute[76049]:         <nova:project uuid="8f28351c85da4988a1f942d5948be8c2">tempest-ServerStableDeviceRescueTest-1167147547</nova:project>
Nov 15 11:18:15 user nova-compute[76049]:       </nova:owner>
Nov 15 11:18:15 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:18:15 user nova-compute[76049]:       <nova:ports>
Nov 15 11:18:15 user nova-compute[76049]:         <nova:port uuid="5a1e963d-d9f8-4923-8b9e-19a1027bba51">
Nov 15 11:18:15 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:18:15 user nova-compute[76049]:         </nova:port>
Nov 15 11:18:15 user nova-compute[76049]:       </nova:ports>
Nov 15 11:18:15 user nova-compute[76049]:     </nova:instance>
Nov 15 11:18:15 user nova-compute[76049]:   </metadata>
Nov 15 11:18:15 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:18:15 user nova-compute[76049]:     <system>
Nov 15 11:18:15 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:18:15 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:18:15 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:18:15 user nova-compute[76049]:       <entry name="serial">00bc4c99-4801-474c-85ad-13534fe75469</entry>
Nov 15 11:18:15 user nova-compute[76049]:       <entry name="uuid">00bc4c99-4801-474c-85ad-13534fe75469</entry>
Nov 15 11:18:15 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:18:15 user nova-compute[76049]:     </system>
Nov 15 11:18:15 user nova-compute[76049]:   </sysinfo>
Nov 15 11:18:15 user nova-compute[76049]:   <os>
Nov 15 11:18:15 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:18:15 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:18:15 user nova-compute[76049]:   </os>
Nov 15 11:18:15 user nova-compute[76049]:   <features>
Nov 15 11:18:15 user nova-compute[76049]:     <acpi/>
Nov 15 11:18:15 user nova-compute[76049]:     <apic/>
Nov 15 11:18:15 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:18:15 user nova-compute[76049]:   </features>
Nov 15 11:18:15 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:18:15 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:18:15 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:18:15 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:18:15 user nova-compute[76049]:   </clock>
Nov 15 11:18:15 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:18:15 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:18:15 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:18:15 user nova-compute[76049]:   </cpu>
Nov 15 11:18:15 user nova-compute[76049]:   <devices>
Nov 15 11:18:15 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:18:15 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:18:15 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk"/>
Nov 15 11:18:15 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:18:15 user nova-compute[76049]:     </disk>
Nov 15 11:18:15 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:18:15 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:18:15 user nova-compute[76049]:       <source dev="/dev/sdc"/>
Nov 15 11:18:15 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:18:15 user nova-compute[76049]:       <serial>e4871c5e-e6f8-409a-8f28-eca543a518eb</serial>
Nov 15 11:18:15 user nova-compute[76049]:     </disk>
Nov 15 11:18:15 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:18:15 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:18:15 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue"/>
Nov 15 11:18:15 user nova-compute[76049]:       <target dev="vdc" bus="virtio"/>
Nov 15 11:18:15 user nova-compute[76049]:       <boot order="1"/>
Nov 15 11:18:15 user nova-compute[76049]:     </disk>
Nov 15 11:18:15 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:18:15 user nova-compute[76049]:       <mac address="fa:16:3e:f4:ca:26"/>
Nov 15 11:18:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:15 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:18:15 user nova-compute[76049]:       <target dev="tap5a1e963d-d9"/>
Nov 15 11:18:15 user nova-compute[76049]:     </interface>
Nov 15 11:18:15 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:18:15 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/console.log" append="off"/>
Nov 15 11:18:15 user nova-compute[76049]:     </serial>
Nov 15 11:18:15 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:18:15 user nova-compute[76049]:     <video>
Nov 15 11:18:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:15 user nova-compute[76049]:     </video>
Nov 15 11:18:15 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:18:15 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:18:15 user nova-compute[76049]:     </rng>
Nov 15 11:18:15 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:18:15 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:18:15 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:18:15 user nova-compute[76049]:     </memballoon>
Nov 15 11:18:15 user nova-compute[76049]:   </devices>
Nov 15 11:18:15 user nova-compute[76049]: </domain>
Nov 15 11:18:15 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dcddee-e96b-455c-a6bd-450eb7e1a4e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10] added
Nov 15 11:18:15 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance destroyed successfully.
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[704f26bd-0748-4a2f-b416-1c3649e1227d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f32a09-78cd-4f96-9366-2de86a1f1910]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZYLEreQ {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZYLEreQ" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e40863-09a8-43c3-8f48-0243a08a6962]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZYLEreQ'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] No VIF found with MAC fa:16:3e:f4:ca:26, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea1fd9f-11ca-49ac-ab5d-e297b072c555]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6686019-2d9c-467e-99e1-d4c746cce79c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:15 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:15 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c11adf7-bac7-4ed7-a207-dfb61d704a24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260]
Nov 15 11:18:15 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:15 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf35871-1e8e-4647-86f3-e0db7fccff7b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8685ee0-eb85-4e70-8919-ca8e41dc0efa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:15 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:15 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:15 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6efeef-9228-488b-a428-acd301d32a49]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZYLEreQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:18:15 user nova-compute[76049]: INFO nova.compute.claims [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Claim successful on node user
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.087s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'pci_requests' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'numa_topology' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:18:16 user nova-compute[76049]: INFO nova.compute.claims [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Claim successful on node user
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:18:16 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.policy [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3405f82948e641e685ecccb007c4c60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d20305cc32b4da29ebe034a326e401e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:18:16 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Creating image(s)
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "/opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== connect_volume: return (1512ms) {'type': 'block', 'scsi_wwn': '23063306564376533', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063306564376533', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1342592007',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1342592007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1342592007',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDYeihAJbgORV6RlPvMoeXiCbkKITOUaL3H8fnfzuJZ/Ahes/BykKbwgKgBiRAbTWHkSwSfEoqpv7zoUkCDRQ7alDPzY5rM9xA+gxjsXz01h2tAt3kZyzfhcOWxXe2FlA==',key_name='tempest-keypair-1461476167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-i1qohs31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:18:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac7d77f50629413bb7b6c9457156af67',uuid=791aeb30-373c-405b-b408-fdba0d4a3cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:2f:20,bridge_name='br-int',has_traffic_filtering=True,id=a55c1b89-518e-4352-95c1-a69902fcda3c,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55c1b89-51') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'pci_devices' on Instance uuid 791aeb30-373c-405b-b408-fdba0d4a3cee {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:18:16 user nova-compute[76049]:   <uuid>791aeb30-373c-405b-b408-fdba0d4a3cee</uuid>
Nov 15 11:18:16 user nova-compute[76049]:   <name>instance-0000001e</name>
Nov 15 11:18:16 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:18:16 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:18:16 user nova-compute[76049]:   <metadata>
Nov 15 11:18:16 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:18:16 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:18:16 user nova-compute[76049]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1342592007</nova:name>
Nov 15 11:18:16 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:18:14</nova:creationTime>
Nov 15 11:18:16 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:18:16 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:18:16 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:18:16 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:18:16 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:18:16 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:18:16 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:18:16 user nova-compute[76049]:       <nova:owner>
Nov 15 11:18:16 user nova-compute[76049]:         <nova:user uuid="ac7d77f50629413bb7b6c9457156af67">tempest-TestVolumeBootPattern-2118546811-project-member</nova:user>
Nov 15 11:18:16 user nova-compute[76049]:         <nova:project uuid="0917737287484e2498e2dcf616b8679e">tempest-TestVolumeBootPattern-2118546811</nova:project>
Nov 15 11:18:16 user nova-compute[76049]:       </nova:owner>
Nov 15 11:18:16 user nova-compute[76049]:       <nova:ports>
Nov 15 11:18:16 user nova-compute[76049]:         <nova:port uuid="a55c1b89-518e-4352-95c1-a69902fcda3c">
Nov 15 11:18:16 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 11:18:16 user nova-compute[76049]:         </nova:port>
Nov 15 11:18:16 user nova-compute[76049]:       </nova:ports>
Nov 15 11:18:16 user nova-compute[76049]:     </nova:instance>
Nov 15 11:18:16 user nova-compute[76049]:   </metadata>
Nov 15 11:18:16 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:18:16 user nova-compute[76049]:     <system>
Nov 15 11:18:16 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:18:16 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:18:16 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:18:16 user nova-compute[76049]:       <entry name="serial">791aeb30-373c-405b-b408-fdba0d4a3cee</entry>
Nov 15 11:18:16 user nova-compute[76049]:       <entry name="uuid">791aeb30-373c-405b-b408-fdba0d4a3cee</entry>
Nov 15 11:18:16 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:18:16 user nova-compute[76049]:     </system>
Nov 15 11:18:16 user nova-compute[76049]:   </sysinfo>
Nov 15 11:18:16 user nova-compute[76049]:   <os>
Nov 15 11:18:16 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:18:16 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:18:16 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:18:16 user nova-compute[76049]:   </os>
Nov 15 11:18:16 user nova-compute[76049]:   <features>
Nov 15 11:18:16 user nova-compute[76049]:     <acpi/>
Nov 15 11:18:16 user nova-compute[76049]:     <apic/>
Nov 15 11:18:16 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:18:16 user nova-compute[76049]:   </features>
Nov 15 11:18:16 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:18:16 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:18:16 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:18:16 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:18:16 user nova-compute[76049]:   </clock>
Nov 15 11:18:16 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:18:16 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:18:16 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:18:16 user nova-compute[76049]:   </cpu>
Nov 15 11:18:16 user nova-compute[76049]:   <devices>
Nov 15 11:18:16 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:18:16 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:18:16 user nova-compute[76049]:       <source dev="/dev/sde"/>
Nov 15 11:18:16 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:18:16 user nova-compute[76049]:       <serial>255a1103-65e5-4bcd-8127-ea2aabbf2b10</serial>
Nov 15 11:18:16 user nova-compute[76049]:     </disk>
Nov 15 11:18:16 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:18:16 user nova-compute[76049]:       <mac address="fa:16:3e:16:2f:20"/>
Nov 15 11:18:16 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:16 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:18:16 user nova-compute[76049]:       <target dev="tapa55c1b89-51"/>
Nov 15 11:18:16 user nova-compute[76049]:     </interface>
Nov 15 11:18:16 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:18:16 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/791aeb30-373c-405b-b408-fdba0d4a3cee/console.log" append="off"/>
Nov 15 11:18:16 user nova-compute[76049]:     </serial>
Nov 15 11:18:16 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:18:16 user nova-compute[76049]:     <video>
Nov 15 11:18:16 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:16 user nova-compute[76049]:     </video>
Nov 15 11:18:16 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:18:16 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:18:16 user nova-compute[76049]:     </rng>
Nov 15 11:18:16 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:18:16 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:18:16 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:18:16 user nova-compute[76049]:     </memballoon>
Nov 15 11:18:16 user nova-compute[76049]:   </devices>
Nov 15 11:18:16 user nova-compute[76049]: </domain>
Nov 15 11:18:16 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1342592007',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1342592007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1342592007',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDYeihAJbgORV6RlPvMoeXiCbkKITOUaL3H8fnfzuJZ/Ahes/BykKbwgKgBiRAbTWHkSwSfEoqpv7zoUkCDRQ7alDPzY5rM9xA+gxjsXz01h2tAt3kZyzfhcOWxXe2FlA==',key_name='tempest-keypair-1461476167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-i1qohs31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:18:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac7d77f50629413bb7b6c9457156af67',uuid=791aeb30-373c-405b-b408-fdba0d4a3cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:2f:20,bridge_name='br-int',has_traffic_filtering=True,id=a55c1b89-518e-4352-95c1-a69902fcda3c,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55c1b89-51') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG os_vif [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:2f:20,bridge_name='br-int',has_traffic_filtering=True,id=a55c1b89-518e-4352-95c1-a69902fcda3c,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55c1b89-51') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f0800e9-30ff-5207-9729-ed5809de73b0', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa55c1b89-51, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa55c1b89-51, col_values=(('qos', UUID('6e118dd0-d39a-438a-b2f6-431745f5498f')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa55c1b89-51, col_values=(('external_ids', {'iface-id': 'a55c1b89-518e-4352-95c1-a69902fcda3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:2f:20', 'vm-uuid': '791aeb30-373c-405b-b408-fdba0d4a3cee'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: INFO os_vif [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:2f:20,bridge_name='br-int',has_traffic_filtering=True,id=a55c1b89-518e-4352-95c1-a69902fcda3c,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55c1b89-51')
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No VIF found with MAC fa:16:3e:16:2f:20, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk 1073741824" returned: 0 in 0.067s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.781s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:16 user nova-compute[76049]: INFO nova.network.neutron [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating port 53fecff6-a026-446e-95ff-97b67e493503 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-ef848751-5ec8-45cc-ab9c-6fd24fe5236a req-75ca1874-8f20-44e6-bff4-6a605ee84533 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef848751-5ec8-45cc-ab9c-6fd24fe5236a req-75ca1874-8f20-44e6-bff4-6a605ee84533 service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef848751-5ec8-45cc-ab9c-6fd24fe5236a req-75ca1874-8f20-44e6-bff4-6a605ee84533 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef848751-5ec8-45cc-ab9c-6fd24fe5236a req-75ca1874-8f20-44e6-bff4-6a605ee84533 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-ef848751-5ec8-45cc-ab9c-6fd24fe5236a req-75ca1874-8f20-44e6-bff4-6a605ee84533 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:16 user nova-compute[76049]: WARNING nova.compute.manager [req-ef848751-5ec8-45cc-ab9c-6fd24fe5236a req-75ca1874-8f20-44e6-bff4-6a605ee84533 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state active and task_state rescuing.
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.228s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:18:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Cannot resize image /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Ensure instance console log exists: /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Successfully created port: f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-changed-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing instance network info cache due to event network-changed-53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:18:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Creating image(s)
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Ensure instance console log exists: /opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Start _get_guest_xml network_info=[{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '692c3208-4d15-4aa6-beca-87a1d2a01e40', 'attached_at': '', 'detached_at': '', 'volume_id': '13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'serial': '13e25910-8dea-43b7-8b04-bb6b6420ecd3'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'a9af9e37-b83c-437a-ac7b-174bcb837691', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing network info cache for port 53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'vcpu_model' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.objects.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Object Instance<692c3208-4d15-4aa6-beca-87a1d2a01e40> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:18 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:18 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:18 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:18:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1799a91-2171-4966-bde2-6898c139422c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:18:18 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Successfully updated port: f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaf1661-b9f3-4a03-b598-6a181c18c962]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3] added
Nov 15 11:18:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquired lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-changed-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Refreshing instance network info cache due to event network-changed-f2928970-70be-4f69-bbb4-7dd28dd12a00. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] Acquiring lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4cd50d-79b1-42d9-afc7-bb3621ad301d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1526ab-f1ed-4c97-a69d-6096741a9b42]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XweUJdoR {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XweUJdoR" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[56452857-8091-4f62-ac5a-bb916f288249]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XweUJdoR'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b6fa4-d719-4e48-8e76-86d6df65ebed]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c6e117-ad48-4f3e-b8d8-a41026b19afc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4671939d-655d-4658-ad1f-ae6d8dd9ec97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]
Nov 15 11:18:18 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e329f-c01f-4bcb-affd-0864be148020]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f3e9a3-f058-42c2-beae-cf0acbe111fb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e21f235-bb94-439d-81db-82bdbc273d64]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Updating instance_info_cache with network_info: [{"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Releasing lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Instance network_info: |[{"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] Acquired lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Refreshing network info cache for port f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Start _get_guest_xml network_info=[{"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-7ba50eac-ef77-4d3a-899c-9d8baf7b094b req-e230d022-483f-45f6-a00a-b5b5f53f928a service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7ba50eac-ef77-4d3a-899c-9d8baf7b094b req-e230d022-483f-45f6-a00a-b5b5f53f928a service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7ba50eac-ef77-4d3a-899c-9d8baf7b094b req-e230d022-483f-45f6-a00a-b5b5f53f928a service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7ba50eac-ef77-4d3a-899c-9d8baf7b094b req-e230d022-483f-45f6-a00a-b5b5f53f928a service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-7ba50eac-ef77-4d3a-899c-9d8baf7b094b req-e230d022-483f-45f6-a00a-b5b5f53f928a service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:18 user nova-compute[76049]: WARNING nova.compute.manager [req-7ba50eac-ef77-4d3a-899c-9d8baf7b094b req-e230d022-483f-45f6-a00a-b5b5f53f928a service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state active and task_state rescuing.
Nov 15 11:18:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:18:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1172032670',display_name='tempest-AttachVolumeNegativeTest-server-1172032670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1172032670',id=31,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAljyrpcQOsZtHgDjq93WiZ/D2yhhEOjU9tNMcdlCC1TbshDBh2SjwTw1GX0kHHRPVzTHpSE/Cm8hmbk87MDBVYMXIe6601wT/+nzWBbo6Fbhu05oePhFYdM7Ov6C/+N4g==',key_name='tempest-keypair-1646149702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-mknt6bc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=64910f05-64cc-4dd7-bfbb-eb7ca622cd7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=f2928970-70be-4f69-bbb4-7dd28dd12a00,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2928970-70') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'pci_devices' on Instance uuid 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updated VIF entry in instance network info cache for port 53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:18:19 user nova-compute[76049]:   <uuid>64910f05-64cc-4dd7-bfbb-eb7ca622cd7d</uuid>
Nov 15 11:18:19 user nova-compute[76049]:   <name>instance-0000001f</name>
Nov 15 11:18:19 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:18:19 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:18:19 user nova-compute[76049]:   <metadata>
Nov 15 11:18:19 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:18:19 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1172032670</nova:name>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:18:18</nova:creationTime>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:18:19 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:18:19 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:owner>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:user uuid="3405f82948e641e685ecccb007c4c60d">tempest-AttachVolumeNegativeTest-2136408759-project-member</nova:user>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:project uuid="2d20305cc32b4da29ebe034a326e401e">tempest-AttachVolumeNegativeTest-2136408759</nova:project>
Nov 15 11:18:19 user nova-compute[76049]:       </nova:owner>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:ports>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:port uuid="f2928970-70be-4f69-bbb4-7dd28dd12a00">
Nov 15 11:18:19 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 11:18:19 user nova-compute[76049]:         </nova:port>
Nov 15 11:18:19 user nova-compute[76049]:       </nova:ports>
Nov 15 11:18:19 user nova-compute[76049]:     </nova:instance>
Nov 15 11:18:19 user nova-compute[76049]:   </metadata>
Nov 15 11:18:19 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:18:19 user nova-compute[76049]:     <system>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="serial">64910f05-64cc-4dd7-bfbb-eb7ca622cd7d</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="uuid">64910f05-64cc-4dd7-bfbb-eb7ca622cd7d</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:18:19 user nova-compute[76049]:     </system>
Nov 15 11:18:19 user nova-compute[76049]:   </sysinfo>
Nov 15 11:18:19 user nova-compute[76049]:   <os>
Nov 15 11:18:19 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:18:19 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:18:19 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:18:19 user nova-compute[76049]:   </os>
Nov 15 11:18:19 user nova-compute[76049]:   <features>
Nov 15 11:18:19 user nova-compute[76049]:     <acpi/>
Nov 15 11:18:19 user nova-compute[76049]:     <apic/>
Nov 15 11:18:19 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:18:19 user nova-compute[76049]:   </features>
Nov 15 11:18:19 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:18:19 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:18:19 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:18:19 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:18:19 user nova-compute[76049]:   </clock>
Nov 15 11:18:19 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:18:19 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:18:19 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:18:19 user nova-compute[76049]:   </cpu>
Nov 15 11:18:19 user nova-compute[76049]:   <devices>
Nov 15 11:18:19 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:18:19 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:18:19 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk"/>
Nov 15 11:18:19 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:18:19 user nova-compute[76049]:     </disk>
Nov 15 11:18:19 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:18:19 user nova-compute[76049]:       <mac address="fa:16:3e:3e:9b:cd"/>
Nov 15 11:18:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:19 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:18:19 user nova-compute[76049]:       <target dev="tapf2928970-70"/>
Nov 15 11:18:19 user nova-compute[76049]:     </interface>
Nov 15 11:18:19 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:18:19 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/console.log" append="off"/>
Nov 15 11:18:19 user nova-compute[76049]:     </serial>
Nov 15 11:18:19 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:18:19 user nova-compute[76049]:     <video>
Nov 15 11:18:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:19 user nova-compute[76049]:     </video>
Nov 15 11:18:19 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:18:19 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:18:19 user nova-compute[76049]:     </rng>
Nov 15 11:18:19 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:18:19 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:18:19 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:18:19 user nova-compute[76049]:     </memballoon>
Nov 15 11:18:19 user nova-compute[76049]:   </devices>
Nov 15 11:18:19 user nova-compute[76049]: </domain>
Nov 15 11:18:19 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1172032670',display_name='tempest-AttachVolumeNegativeTest-server-1172032670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1172032670',id=31,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAljyrpcQOsZtHgDjq93WiZ/D2yhhEOjU9tNMcdlCC1TbshDBh2SjwTw1GX0kHHRPVzTHpSE/Cm8hmbk87MDBVYMXIe6601wT/+nzWBbo6Fbhu05oePhFYdM7Ov6C/+N4g==',key_name='tempest-keypair-1646149702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-mknt6bc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=64910f05-64cc-4dd7-bfbb-eb7ca622cd7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=f2928970-70be-4f69-bbb4-7dd28dd12a00,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2928970-70') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG os_vif [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=f2928970-70be-4f69-bbb4-7dd28dd12a00,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2928970-70') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-49b2bb72-8fcb-434d-a73b-65ad1d21d7f3 req-24257b95-835e-4dc1-9f1b-aa656602f199 service nova] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5953efd8-62e7-5628-a764-58bb8d35813e', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2928970-70, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2928970-70, col_values=(('qos', UUID('09004343-45e4-43af-89e6-ba208dd13c8a')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2928970-70, col_values=(('external_ids', {'iface-id': 'f2928970-70be-4f69-bbb4-7dd28dd12a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:9b:cd', 'vm-uuid': '64910f05-64cc-4dd7-bfbb-eb7ca622cd7d'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: INFO os_vif [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=f2928970-70be-4f69-bbb4-7dd28dd12a00,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2928970-70')
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No VIF found with MAC fa:16:3e:3e:9b:cd, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Updated VIF entry in instance network info cache for port f2928970-70be-4f69-bbb4-7dd28dd12a00. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Updating instance_info_cache with network_info: [{"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc2f157b-0224-4fc7-8928-505ddf9179b8 req-9bd070dc-daf2-4066-9efa-efa905917e6d service nova] Releasing lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '26333633434393535', 'path': '/dev/sdf'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333633434393535', 'path': '/dev/sdf'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-408780271',display_name='tempest-TestShelveInstance-server-408780271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-408780271',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-236142358',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6517681dc6ca4788a7ae3e969a9831cc',ramdisk_id='',reservation_id='r-2kbv4mks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289836315',owner_user_name='tempest-TestShelveInstance-289836315-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:10Z,user_data=None,user_id='842ce026504c47a993bbda489c8385a4',uuid=692c3208-4d15-4aa6-beca-87a1d2a01e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converting VIF {"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'pci_devices' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.objects.base [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Object Instance<692c3208-4d15-4aa6-beca-87a1d2a01e40> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:18:19 user nova-compute[76049]:   <uuid>692c3208-4d15-4aa6-beca-87a1d2a01e40</uuid>
Nov 15 11:18:19 user nova-compute[76049]:   <name>instance-00000015</name>
Nov 15 11:18:19 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:18:19 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:18:19 user nova-compute[76049]:   <metadata>
Nov 15 11:18:19 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:18:19 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:name>tempest-TestShelveInstance-server-408780271</nova:name>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:18:18</nova:creationTime>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:18:19 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:18:19 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:owner>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:user uuid="842ce026504c47a993bbda489c8385a4">tempest-TestShelveInstance-289836315-project-member</nova:user>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:project uuid="6517681dc6ca4788a7ae3e969a9831cc">tempest-TestShelveInstance-289836315</nova:project>
Nov 15 11:18:19 user nova-compute[76049]:       </nova:owner>
Nov 15 11:18:19 user nova-compute[76049]:       <nova:ports>
Nov 15 11:18:19 user nova-compute[76049]:         <nova:port uuid="53fecff6-a026-446e-95ff-97b67e493503">
Nov 15 11:18:19 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 11:18:19 user nova-compute[76049]:         </nova:port>
Nov 15 11:18:19 user nova-compute[76049]:       </nova:ports>
Nov 15 11:18:19 user nova-compute[76049]:     </nova:instance>
Nov 15 11:18:19 user nova-compute[76049]:   </metadata>
Nov 15 11:18:19 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:18:19 user nova-compute[76049]:     <system>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="serial">692c3208-4d15-4aa6-beca-87a1d2a01e40</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="uuid">692c3208-4d15-4aa6-beca-87a1d2a01e40</entry>
Nov 15 11:18:19 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:18:19 user nova-compute[76049]:     </system>
Nov 15 11:18:19 user nova-compute[76049]:   </sysinfo>
Nov 15 11:18:19 user nova-compute[76049]:   <os>
Nov 15 11:18:19 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:18:19 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:18:19 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:18:19 user nova-compute[76049]:   </os>
Nov 15 11:18:19 user nova-compute[76049]:   <features>
Nov 15 11:18:19 user nova-compute[76049]:     <acpi/>
Nov 15 11:18:19 user nova-compute[76049]:     <apic/>
Nov 15 11:18:19 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:18:19 user nova-compute[76049]:   </features>
Nov 15 11:18:19 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:18:19 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:18:19 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:18:19 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:18:19 user nova-compute[76049]:   </clock>
Nov 15 11:18:19 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:18:19 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:18:19 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:18:19 user nova-compute[76049]:   </cpu>
Nov 15 11:18:19 user nova-compute[76049]:   <devices>
Nov 15 11:18:19 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:18:19 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:18:19 user nova-compute[76049]:       <source dev="/dev/sdf"/>
Nov 15 11:18:19 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:18:19 user nova-compute[76049]:       <serial>13e25910-8dea-43b7-8b04-bb6b6420ecd3</serial>
Nov 15 11:18:19 user nova-compute[76049]:     </disk>
Nov 15 11:18:19 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:18:19 user nova-compute[76049]:       <mac address="fa:16:3e:a9:b6:b6"/>
Nov 15 11:18:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:19 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:18:19 user nova-compute[76049]:       <target dev="tap53fecff6-a0"/>
Nov 15 11:18:19 user nova-compute[76049]:     </interface>
Nov 15 11:18:19 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:18:19 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40/console.log" append="off"/>
Nov 15 11:18:19 user nova-compute[76049]:     </serial>
Nov 15 11:18:19 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:18:19 user nova-compute[76049]:     <video>
Nov 15 11:18:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:19 user nova-compute[76049]:     </video>
Nov 15 11:18:19 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:18:19 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:18:19 user nova-compute[76049]:     </rng>
Nov 15 11:18:19 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:18:19 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:18:19 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:18:19 user nova-compute[76049]:     </memballoon>
Nov 15 11:18:19 user nova-compute[76049]:   </devices>
Nov 15 11:18:19 user nova-compute[76049]: </domain>
Nov 15 11:18:19 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-408780271',display_name='tempest-TestShelveInstance-server-408780271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-408780271',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-236142358',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6517681dc6ca4788a7ae3e969a9831cc',ramdisk_id='',reservation_id='r-2kbv4mks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289836315',owner_user_name='tempest-TestShelveInstance-289836315-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:10Z,user_data=None,user_id='842ce026504c47a993bbda489c8385a4',uuid=692c3208-4d15-4aa6-beca-87a1d2a01e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converting VIF {"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG os_vif [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3bb80fe-e3e2-56dd-a34a-fc515a5f3aee', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53fecff6-a0, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53fecff6-a0, col_values=(('qos', UUID('d9eddb26-9fd6-4c6b-8fa5-f2b28d144efc')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53fecff6-a0, col_values=(('external_ids', {'iface-id': '53fecff6-a026-446e-95ff-97b67e493503', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:b6:b6', 'vm-uuid': '692c3208-4d15-4aa6-beca-87a1d2a01e40'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:19 user nova-compute[76049]: INFO os_vif [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0')
Nov 15 11:18:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] No VIF found with MAC fa:16:3e:a9:b6:b6, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:18:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-cd000610-9392-4ca7-a4aa-c7a7c40809e5 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Instance spawned successfully.
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:21 user nova-compute[76049]: INFO nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 15 11:18:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:21 user nova-compute[76049]: INFO nova.compute.manager [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Took 13.14 seconds to build instance.
Nov 15 11:18:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8f8e401e-4a1a-4254-b34a-012f5cabe2b7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.251s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG nova.objects.instance [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'flavor' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-47e14400-775f-4753-9779-a0bee0daa1a1 req-31080cc3-700d-45b0-a301-534c365575f2 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-47e14400-775f-4753-9779-a0bee0daa1a1 req-31080cc3-700d-45b0-a301-534c365575f2 service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-47e14400-775f-4753-9779-a0bee0daa1a1 req-31080cc3-700d-45b0-a301-534c365575f2 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-47e14400-775f-4753-9779-a0bee0daa1a1 req-31080cc3-700d-45b0-a301-534c365575f2 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-47e14400-775f-4753-9779-a0bee0daa1a1 req-31080cc3-700d-45b0-a301-534c365575f2 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:22 user nova-compute[76049]: WARNING nova.compute.manager [req-47e14400-775f-4753-9779-a0bee0daa1a1 req-31080cc3-700d-45b0-a301-534c365575f2 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received unexpected event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:22 user nova-compute[76049]: INFO nova.compute.manager [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Attaching volume 1799b425-ccd4-4dc9-a183-022c4b3eb855 to /dev/vdb
Nov 15 11:18:22 user nova-compute[76049]: DEBUG os_brick.utils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb9d829-3d34-49a9-a0f9-bceaa67d2709]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b216ec8-8043-4e66-a9d8-246ddb373890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aa1ffd-be74-4cc3-b2e3-008c6b54e121]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edeed64-bad9-4ff4-b663-9b4afc88e367]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:18:23 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35693e1-fa1e-4e1c-beb0-b8e58d657d41]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG os_brick.utils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating existing volume attachment record: 1a8517b1-3122-4f6a-b8f5-0fc1d5ee5e8d {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-changed-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Refreshing instance network info cache due to event network-changed-0495d054-d8d9-4a64-8306-3ae999cdb253. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] Acquiring lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] Acquired lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Refreshing network info cache for port 0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updated VIF entry in instance network info cache for port 0495d054-d8d9-4a64-8306-3ae999cdb253. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-06378ada-c9de-4ba8-aa03-9d63fb189e6b req-544a5981-8b34-469c-96bf-7fb2b6847c7b service nova] Releasing lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-e66fe6e5-a727-4105-b7a2-4c6be58cdd64 req-3b69e549-ff9a-4779-8cbf-f3653bc0a6af service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e66fe6e5-a727-4105-b7a2-4c6be58cdd64 req-3b69e549-ff9a-4779-8cbf-f3653bc0a6af service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e66fe6e5-a727-4105-b7a2-4c6be58cdd64 req-3b69e549-ff9a-4779-8cbf-f3653bc0a6af service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e66fe6e5-a727-4105-b7a2-4c6be58cdd64 req-3b69e549-ff9a-4779-8cbf-f3653bc0a6af service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-e66fe6e5-a727-4105-b7a2-4c6be58cdd64 req-3b69e549-ff9a-4779-8cbf-f3653bc0a6af service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:24 user nova-compute[76049]: WARNING nova.compute.manager [req-e66fe6e5-a727-4105-b7a2-4c6be58cdd64 req-3b69e549-ff9a-4779-8cbf-f3653bc0a6af service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received unexpected event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 11:18:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:18:25 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Instance spawned successfully.
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:18:25 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance spawned successfully.
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:25 user nova-compute[76049]: INFO nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Took 9.09 seconds to spawn the instance on the hypervisor.
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1584c8ec-ec51-4bca-9943-68543700a87e tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.292s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Acquiring lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] No waiting events found dispatching network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:25 user nova-compute[76049]: WARNING nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received unexpected event network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c for instance with vm_state active and task_state None.
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Acquiring lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] No waiting events found dispatching network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:25 user nova-compute[76049]: WARNING nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received unexpected event network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c for instance with vm_state active and task_state None.
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] No waiting events found dispatching network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:25 user nova-compute[76049]: WARNING nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received unexpected event network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 for instance with vm_state building and task_state spawning.
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] No waiting events found dispatching network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:25 user nova-compute[76049]: WARNING nova.compute.manager [req-f39f9a13-934c-4369-9219-989ae0df353a req-d17bbb40-3946-4e4a-9c49-14e6e2062075 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received unexpected event network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 for instance with vm_state building and task_state spawning.
Nov 15 11:18:25 user nova-compute[76049]: INFO nova.compute.manager [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Took 10.12 seconds to build instance.
Nov 15 11:18:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5826c3d6-bd3a-4238-89ba-e2acd2571d77 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.236s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:18:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquired lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'info_cache' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG nova.objects.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqbAHVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:29 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:29 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:29 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0c90f4-e90c-4334-9c4c-f8ae4d30a792]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:18:29 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6142a8d-993e-44fb-bf3c-07ffe22f4c0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855] added
Nov 15 11:18:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab84de-503f-41e5-adff-b29d086b9018]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc0596-505c-41b6-9d34-b1ec9c97d4b6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqbAHVP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqbAHVP" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca31c07d-4113-42d5-9bd8-4fe711d4b80b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWqbAHVP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f569ac-83d9-4a2d-b137-be6fa02c02f6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bfe669-aaa3-49b2-9822-9dc2ca4f1a45]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:29 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f369bb9-e846-4476-bbeb-9b2d3e619626]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]
Nov 15 11:18:30 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[765e6594-bea2-4719-bc55-5c705fb8ef21]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a33bfe-1465-4d60-9fcc-3f98be899948]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.507s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Releasing lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e00ac5a-8902-4ce9-be0e-1aeddb18d08e]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqbAHVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.490s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:30 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance destroyed successfully.
Nov 15 11:18:30 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'resources' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG nova.objects.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:16:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_vif [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ba8d621-88, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdd05101-6b3f-4621-97ec-eacf1df548db) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:30 user nova-compute[76049]: INFO os_vif [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88')
Nov 15 11:18:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYSJGMXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:30 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.553s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '23631346136613539', 'path': '/dev/sdg'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346136613539', 'path': '/dev/sdg'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.508s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.objects.instance [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'flavor' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d915ef0c-5898-4845-86fa-37a7c72c4294]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:18:31 user nova-compute[76049]: No targets found.
Nov 15 11:18:31 user nova-compute[76049]: iSNS:
Nov 15 11:18:31 user nova-compute[76049]: No targets found.
Nov 15 11:18:31 user nova-compute[76049]: STATIC:
Nov 15 11:18:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:18:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:18:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:18:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:18:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:18:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:18:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:31 user nova-compute[76049]: FIRMWARE:
Nov 15 11:18:31 user nova-compute[76049]: No targets found.
Nov 15 11:18:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:18:31 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:18:31 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:18:31 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:18:31 user nova-compute[76049]:   <source dev="/dev/sdg"/>
Nov 15 11:18:31 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:18:31 user nova-compute[76049]:   <serial>1799b425-ccd4-4dc9-a183-022c4b3eb855</serial>
Nov 15 11:18:31 user nova-compute[76049]: </disk>
Nov 15 11:18:31 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0fe042-29c8-4f61-aee9-3e8057806cc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5afe9-97db-4902-8aed-2a7aae5ae2ab]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607ad6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6cf46d-be80-4d28-ae9f-9523172662be]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a563c02-b52b-4dce-879a-c91df25b526f]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898addf-58bf-4d29-bb96-a5f56d1f522c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0cf84-0f7d-4102-aca7-1225ca5116d2]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b950d07-f804-42f3-ae43-19e22a414996]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c5ca8-565c-4e5e-8b5d-3b1414bca3c1]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]
Nov 15 11:18:31 user nova-compute[76049]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc546d89-3c02-4268-b2c2-a0b789ba2ee5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== disconnect_volume: return (998ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Start _get_guest_xml network_info=[{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYSJGMXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '125d7724-a310-49e5-9117-3c6a0527b117', 'attached_at': '', 'detached_at': '', 'volume_id': '42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'serial': '42cd664b-e9b0-472a-8695-e0ed4c1a62e5'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '0ba7c420-f0f6-4946-84a7-0c3f11ad901a', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'numa_topology' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.objects.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.objects.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYSJGMXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:31 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No VIF found with MAC fa:16:3e:11:f9:3e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9ed9b-8d71-42f0-b13e-2520838bf00b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:18:31 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c4bd4-3b8c-4874-9173-44116526e7ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5] added
Nov 15 11:18:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be/disk.rescue --force-share --output=json" returned: 0 in 0.359s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '125d7724-a310-49e5-9117-3c6a0527b117' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '125d7724-a310-49e5-9117-3c6a0527b117' (instance-00000016)
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16773e2-d71d-468d-9a4e-9ec9d8d1ef70]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eb482a-8445-4d7c-9f25-c89f0117326a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYSJGMXT {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYSJGMXT" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[336cc96b-6a0c-4445-a301-e08c1c1e7c3d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jYSJGMXT'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef0d7fe-185d-45ae-84d0-386846b80f17]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-52d4cf0c-2ee6-40a1-a23a-e042a379e99f tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.305s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc1efd-bb28-43b1-be1c-9b526bed4cec]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc13dcb7-2d88-4e10-a575-271565c564a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]
Nov 15 11:18:32 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd1834d-6a3c-4bb0-b49e-fe1c1aafe29b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d285e9-d064-44d2-88eb-eacd05ba16b2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f99a25-b595-4de8-9181-1cccde86a55d]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYSJGMXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '23337313730613432', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337313730613432', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:16:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'pci_devices' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.objects.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:18:33 user nova-compute[76049]:   <uuid>125d7724-a310-49e5-9117-3c6a0527b117</uuid>
Nov 15 11:18:33 user nova-compute[76049]:   <name>instance-00000016</name>
Nov 15 11:18:33 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:18:33 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:18:33 user nova-compute[76049]:   <metadata>
Nov 15 11:18:33 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:18:33 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:18:33 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeTestJSON-server-533537040</nova:name>
Nov 15 11:18:33 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:18:31</nova:creationTime>
Nov 15 11:18:33 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:18:33 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:18:33 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:18:33 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:18:33 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:18:33 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:18:33 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:18:33 user nova-compute[76049]:       <nova:owner>
Nov 15 11:18:33 user nova-compute[76049]:         <nova:user uuid="aab3b8846d7649a78b8f0be07f51945e">tempest-AttachVolumeTestJSON-401613630-project-member</nova:user>
Nov 15 11:18:33 user nova-compute[76049]:         <nova:project uuid="b66e129b2747494fb8fa7cb798b7dc3c">tempest-AttachVolumeTestJSON-401613630</nova:project>
Nov 15 11:18:33 user nova-compute[76049]:       </nova:owner>
Nov 15 11:18:33 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:18:33 user nova-compute[76049]:       <nova:ports>
Nov 15 11:18:33 user nova-compute[76049]:         <nova:port uuid="5ba8d621-889a-4c32-889b-d0cd4adf2472">
Nov 15 11:18:33 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:18:33 user nova-compute[76049]:         </nova:port>
Nov 15 11:18:33 user nova-compute[76049]:       </nova:ports>
Nov 15 11:18:33 user nova-compute[76049]:     </nova:instance>
Nov 15 11:18:33 user nova-compute[76049]:   </metadata>
Nov 15 11:18:33 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:18:33 user nova-compute[76049]:     <system>
Nov 15 11:18:33 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:18:33 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:18:33 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:18:33 user nova-compute[76049]:       <entry name="serial">125d7724-a310-49e5-9117-3c6a0527b117</entry>
Nov 15 11:18:33 user nova-compute[76049]:       <entry name="uuid">125d7724-a310-49e5-9117-3c6a0527b117</entry>
Nov 15 11:18:33 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:18:33 user nova-compute[76049]:     </system>
Nov 15 11:18:33 user nova-compute[76049]:   </sysinfo>
Nov 15 11:18:33 user nova-compute[76049]:   <os>
Nov 15 11:18:33 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:18:33 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:18:33 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:18:33 user nova-compute[76049]:   </os>
Nov 15 11:18:33 user nova-compute[76049]:   <features>
Nov 15 11:18:33 user nova-compute[76049]:     <acpi/>
Nov 15 11:18:33 user nova-compute[76049]:     <apic/>
Nov 15 11:18:33 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:18:33 user nova-compute[76049]:   </features>
Nov 15 11:18:33 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:18:33 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:18:33 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:18:33 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:18:33 user nova-compute[76049]:   </clock>
Nov 15 11:18:33 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:18:33 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:18:33 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:18:33 user nova-compute[76049]:   </cpu>
Nov 15 11:18:33 user nova-compute[76049]:   <devices>
Nov 15 11:18:33 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:18:33 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:18:33 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk"/>
Nov 15 11:18:33 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:18:33 user nova-compute[76049]:     </disk>
Nov 15 11:18:33 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:18:33 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:18:33 user nova-compute[76049]:       <source dev="/dev/sdb"/>
Nov 15 11:18:33 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:18:33 user nova-compute[76049]:       <serial>42cd664b-e9b0-472a-8695-e0ed4c1a62e5</serial>
Nov 15 11:18:33 user nova-compute[76049]:     </disk>
Nov 15 11:18:33 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:18:33 user nova-compute[76049]:       <mac address="fa:16:3e:79:34:99"/>
Nov 15 11:18:33 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:33 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:18:33 user nova-compute[76049]:       <target dev="tap5ba8d621-88"/>
Nov 15 11:18:33 user nova-compute[76049]:     </interface>
Nov 15 11:18:33 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:18:33 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/console.log" append="off"/>
Nov 15 11:18:33 user nova-compute[76049]:     </serial>
Nov 15 11:18:33 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:18:33 user nova-compute[76049]:     <video>
Nov 15 11:18:33 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:33 user nova-compute[76049]:     </video>
Nov 15 11:18:33 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:18:33 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:18:33 user nova-compute[76049]:     </rng>
Nov 15 11:18:33 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:18:33 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:18:33 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:18:33 user nova-compute[76049]:     </memballoon>
Nov 15 11:18:33 user nova-compute[76049]:   </devices>
Nov 15 11:18:33 user nova-compute[76049]: </domain>
Nov 15 11:18:33 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:18:33 user nova-compute[76049]: INFO nova.compute.claims [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Claim successful on node user
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.616s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'trusted_certs' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:34 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:34 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7361MB free_disk=25.071224212646484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.objects.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.224s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.223s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.428s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Cannot resize image /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'migration_context' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.objects.base [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:16:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG os_vif [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f6d92c5-a809-5a71-8a74-fe514389e03c', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ba8d621-88, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ba8d621-88, col_values=(('qos', UUID('633e5b98-c3a0-4ab2-814a-88622dfda952')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ba8d621-88, col_values=(('external_ids', {'iface-id': '5ba8d621-889a-4c32-889b-d0cd4adf2472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:34:99', 'vm-uuid': '125d7724-a310-49e5-9117-3c6a0527b117'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:18:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:34 user nova-compute[76049]: INFO os_vif [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88')
Nov 15 11:18:34 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:18:34 user nova-compute[76049]: DEBUG nova.policy [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5ff0ce1406b45b7b132cc46a0a03ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe816645ab1945a38fb163eb899898b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 00bc4c99-4801-474c-85ad-13534fe75469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 791aeb30-373c-405b-b408-fdba0d4a3cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 692c3208-4d15-4aa6-beca-87a1d2a01e40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:18:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Creating image(s)
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "/opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "/opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "/opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.209s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.241s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk 1073741824" returned: 0 in 0.067s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:18:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.128s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.269s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Cannot resize image /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Ensure instance console log exists: /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Successfully created port: 56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-d52266da-cc6e-4eae-b679-af5ded5f90bb req-0d742e92-64ad-4bdd-b4f0-da47a59d0b4d service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d52266da-cc6e-4eae-b679-af5ded5f90bb req-0d742e92-64ad-4bdd-b4f0-da47a59d0b4d service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d52266da-cc6e-4eae-b679-af5ded5f90bb req-0d742e92-64ad-4bdd-b4f0-da47a59d0b4d service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d52266da-cc6e-4eae-b679-af5ded5f90bb req-0d742e92-64ad-4bdd-b4f0-da47a59d0b4d service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-d52266da-cc6e-4eae-b679-af5ded5f90bb req-0d742e92-64ad-4bdd-b4f0-da47a59d0b4d service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:36 user nova-compute[76049]: WARNING nova.compute.manager [req-d52266da-cc6e-4eae-b679-af5ded5f90bb req-0d742e92-64ad-4bdd-b4f0-da47a59d0b4d service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state stopped and task_state powering-on.
Nov 15 11:18:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing instance network info cache due to event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] Acquiring lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] Acquired lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Successfully updated port: 56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquired lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updated VIF entry in instance network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-2918deee-ec13-43f0-97bc-662f6f170563 req-33217614-f0db-4d75-a798-b7e68c0cad4c service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2918deee-ec13-43f0-97bc-662f6f170563 req-33217614-f0db-4d75-a798-b7e68c0cad4c service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2918deee-ec13-43f0-97bc-662f6f170563 req-33217614-f0db-4d75-a798-b7e68c0cad4c service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2918deee-ec13-43f0-97bc-662f6f170563 req-33217614-f0db-4d75-a798-b7e68c0cad4c service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-2918deee-ec13-43f0-97bc-662f6f170563 req-33217614-f0db-4d75-a798-b7e68c0cad4c service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:38 user nova-compute[76049]: WARNING nova.compute.manager [req-2918deee-ec13-43f0-97bc-662f6f170563 req-33217614-f0db-4d75-a798-b7e68c0cad4c service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state stopped and task_state powering-on.
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0a10abf0-9354-4051-9e31-4def7da424f1 req-86c26515-8388-47ac-80d3-7b95bd42010e service nova] Releasing lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating instance_info_cache with network_info: [{"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Releasing lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Instance network_info: |[{"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Start _get_guest_xml network_info=[{"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:18:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1563173912',display_name='tempest-SnapshotDataIntegrityTests-server-1563173912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1563173912',id=32,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6rAVgalO7+g87UMMruvnA9gZH81tSEjBKFUM7OUa0iZMZRpX8xkWg38eS5oW1NB2MHv7EFZJvknJ0S2c9Rbx6+3rkAKl6KX2tpdn80stT+fZuqUHpJGdQlUWhS6JCK2g==',key_name='tempest-keypair-282384105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe816645ab1945a38fb163eb899898b2',ramdisk_id='',reservation_id='r-90pxvz8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-334074251',owner_user_name='tempest-SnapshotDataIntegrityTests-334074251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:18:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ff0ce1406b45b7b132cc46a0a03ce8',uuid=4640743d-7ecc-4dd8-b892-1135a3add8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Converting VIF {"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=56fdea95-142b-46f5-9040-eb62a67c9fdc,network=Network(737fa543-dc08-4caf-8ac7-9c9fb3456d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fdea95-14') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'pci_devices' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:18:38 user nova-compute[76049]:   <uuid>4640743d-7ecc-4dd8-b892-1135a3add8a1</uuid>
Nov 15 11:18:38 user nova-compute[76049]:   <name>instance-00000020</name>
Nov 15 11:18:38 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:18:38 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:18:38 user nova-compute[76049]:   <metadata>
Nov 15 11:18:38 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:18:38 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:18:38 user nova-compute[76049]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1563173912</nova:name>
Nov 15 11:18:38 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:18:38</nova:creationTime>
Nov 15 11:18:38 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:18:38 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:18:38 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:18:38 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:18:38 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:18:38 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:18:38 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:18:38 user nova-compute[76049]:       <nova:owner>
Nov 15 11:18:38 user nova-compute[76049]:         <nova:user uuid="a5ff0ce1406b45b7b132cc46a0a03ce8">tempest-SnapshotDataIntegrityTests-334074251-project-member</nova:user>
Nov 15 11:18:38 user nova-compute[76049]:         <nova:project uuid="fe816645ab1945a38fb163eb899898b2">tempest-SnapshotDataIntegrityTests-334074251</nova:project>
Nov 15 11:18:38 user nova-compute[76049]:       </nova:owner>
Nov 15 11:18:38 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:18:38 user nova-compute[76049]:       <nova:ports>
Nov 15 11:18:38 user nova-compute[76049]:         <nova:port uuid="56fdea95-142b-46f5-9040-eb62a67c9fdc">
Nov 15 11:18:38 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 11:18:38 user nova-compute[76049]:         </nova:port>
Nov 15 11:18:38 user nova-compute[76049]:       </nova:ports>
Nov 15 11:18:38 user nova-compute[76049]:     </nova:instance>
Nov 15 11:18:38 user nova-compute[76049]:   </metadata>
Nov 15 11:18:38 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:18:38 user nova-compute[76049]:     <system>
Nov 15 11:18:38 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:18:38 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:18:38 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:18:38 user nova-compute[76049]:       <entry name="serial">4640743d-7ecc-4dd8-b892-1135a3add8a1</entry>
Nov 15 11:18:38 user nova-compute[76049]:       <entry name="uuid">4640743d-7ecc-4dd8-b892-1135a3add8a1</entry>
Nov 15 11:18:38 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:18:38 user nova-compute[76049]:     </system>
Nov 15 11:18:38 user nova-compute[76049]:   </sysinfo>
Nov 15 11:18:38 user nova-compute[76049]:   <os>
Nov 15 11:18:38 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:18:38 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:18:38 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:18:38 user nova-compute[76049]:   </os>
Nov 15 11:18:38 user nova-compute[76049]:   <features>
Nov 15 11:18:38 user nova-compute[76049]:     <acpi/>
Nov 15 11:18:38 user nova-compute[76049]:     <apic/>
Nov 15 11:18:38 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:18:38 user nova-compute[76049]:   </features>
Nov 15 11:18:38 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:18:38 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:18:38 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:18:38 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:18:38 user nova-compute[76049]:   </clock>
Nov 15 11:18:38 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:18:38 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:18:38 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:18:38 user nova-compute[76049]:   </cpu>
Nov 15 11:18:38 user nova-compute[76049]:   <devices>
Nov 15 11:18:38 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:18:38 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:18:38 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk"/>
Nov 15 11:18:38 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:18:38 user nova-compute[76049]:     </disk>
Nov 15 11:18:38 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:18:38 user nova-compute[76049]:       <mac address="fa:16:3e:d8:c1:d4"/>
Nov 15 11:18:38 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:38 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:18:38 user nova-compute[76049]:       <target dev="tap56fdea95-14"/>
Nov 15 11:18:38 user nova-compute[76049]:     </interface>
Nov 15 11:18:38 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:18:38 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/console.log" append="off"/>
Nov 15 11:18:38 user nova-compute[76049]:     </serial>
Nov 15 11:18:38 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:18:38 user nova-compute[76049]:     <video>
Nov 15 11:18:38 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:38 user nova-compute[76049]:     </video>
Nov 15 11:18:38 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:18:38 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:18:38 user nova-compute[76049]:     </rng>
Nov 15 11:18:38 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:18:38 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:18:38 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:18:38 user nova-compute[76049]:     </memballoon>
Nov 15 11:18:38 user nova-compute[76049]:   </devices>
Nov 15 11:18:38 user nova-compute[76049]: </domain>
Nov 15 11:18:38 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1563173912',display_name='tempest-SnapshotDataIntegrityTests-server-1563173912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1563173912',id=32,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6rAVgalO7+g87UMMruvnA9gZH81tSEjBKFUM7OUa0iZMZRpX8xkWg38eS5oW1NB2MHv7EFZJvknJ0S2c9Rbx6+3rkAKl6KX2tpdn80stT+fZuqUHpJGdQlUWhS6JCK2g==',key_name='tempest-keypair-282384105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe816645ab1945a38fb163eb899898b2',ramdisk_id='',reservation_id='r-90pxvz8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-334074251',owner_user_name='tempest-SnapshotDataIntegrityTests-334074251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:18:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ff0ce1406b45b7b132cc46a0a03ce8',uuid=4640743d-7ecc-4dd8-b892-1135a3add8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Converting VIF {"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=56fdea95-142b-46f5-9040-eb62a67c9fdc,network=Network(737fa543-dc08-4caf-8ac7-9c9fb3456d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fdea95-14') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG os_vif [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=56fdea95-142b-46f5-9040-eb62a67c9fdc,network=Network(737fa543-dc08-4caf-8ac7-9c9fb3456d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fdea95-14') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33e2e80d-7d49-5e0d-998f-27e534e67a2a', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56fdea95-14, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56fdea95-14, col_values=(('qos', UUID('c8119e0b-4fe3-45c5-9eee-92320ac39788')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56fdea95-14, col_values=(('external_ids', {'iface-id': '56fdea95-142b-46f5-9040-eb62a67c9fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:c1:d4', 'vm-uuid': '4640743d-7ecc-4dd8-b892-1135a3add8a1'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:38 user nova-compute[76049]: INFO os_vif [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=56fdea95-142b-46f5-9040-eb62a67c9fdc,network=Network(737fa543-dc08-4caf-8ac7-9c9fb3456d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fdea95-14')
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No VIF found with MAC fa:16:3e:d8:c1:d4, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing instance network info cache due to event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] Acquiring lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] Acquired lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:38 user nova-compute[76049]: DEBUG nova.network.neutron [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:18:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance rebooted successfully.
Nov 15 11:18:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a1e0bca2-86a8-469b-b579-4d978197e0aa tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:39 user nova-compute[76049]: DEBUG nova.network.neutron [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updated VIF entry in instance network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:39 user nova-compute[76049]: DEBUG nova.network.neutron [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f37958c9-5864-48d9-9aae-05b6c101a874 req-d08ba551-b7a2-4252-b1e5-75f2e41438b4 service nova] Releasing lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-changed-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Refreshing instance network info cache due to event network-changed-56fdea95-142b-46f5-9040-eb62a67c9fdc. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] Acquiring lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] Acquired lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Refreshing network info cache for port 56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-559b51b5-5cdb-4b14-9d14-ff160a575465 req-c5acca84-2a20-4286-836a-90e05a6e48cf service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-559b51b5-5cdb-4b14-9d14-ff160a575465 req-c5acca84-2a20-4286-836a-90e05a6e48cf service nova] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-559b51b5-5cdb-4b14-9d14-ff160a575465 req-c5acca84-2a20-4286-836a-90e05a6e48cf service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-559b51b5-5cdb-4b14-9d14-ff160a575465 req-c5acca84-2a20-4286-836a-90e05a6e48cf service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-559b51b5-5cdb-4b14-9d14-ff160a575465 req-c5acca84-2a20-4286-836a-90e05a6e48cf service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] No waiting events found dispatching network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:40 user nova-compute[76049]: WARNING nova.compute.manager [req-559b51b5-5cdb-4b14-9d14-ff160a575465 req-c5acca84-2a20-4286-836a-90e05a6e48cf service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received unexpected event network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc for instance with vm_state building and task_state spawning.
Nov 15 11:18:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updated VIF entry in instance network info cache for port 56fdea95-142b-46f5-9040-eb62a67c9fdc. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating instance_info_cache with network_info: [{"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f55ae144-baa1-468d-8078-b298176de4c9 req-e6f94635-6249-443e-992b-4a45df0e4107 service nova] Releasing lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:42 user nova-compute[76049]: INFO nova.compute.manager [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Shelving
Nov 15 11:18:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-787994a3-cef6-49d7-8c9a-a56535d71765 req-2ee78dad-99cf-43ca-82ea-be91d9b393f0 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-787994a3-cef6-49d7-8c9a-a56535d71765 req-2ee78dad-99cf-43ca-82ea-be91d9b393f0 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-787994a3-cef6-49d7-8c9a-a56535d71765 req-2ee78dad-99cf-43ca-82ea-be91d9b393f0 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-787994a3-cef6-49d7-8c9a-a56535d71765 req-2ee78dad-99cf-43ca-82ea-be91d9b393f0 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-787994a3-cef6-49d7-8c9a-a56535d71765 req-2ee78dad-99cf-43ca-82ea-be91d9b393f0 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:42 user nova-compute[76049]: WARNING nova.compute.manager [req-787994a3-cef6-49d7-8c9a-a56535d71765 req-2ee78dad-99cf-43ca-82ea-be91d9b393f0 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state active and task_state shelving.
Nov 15 11:18:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] No waiting events found dispatching network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:42 user nova-compute[76049]: WARNING nova.compute.manager [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received unexpected event network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc for instance with vm_state building and task_state spawning.
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing instance network info cache due to event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] Acquiring lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] Acquired lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.network.neutron [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:18:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Instance spawned successfully.
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:18:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance destroyed successfully.
Nov 15 11:18:43 user nova-compute[76049]: INFO nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Took 7.90 seconds to spawn the instance on the hypervisor.
Nov 15 11:18:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:43 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Beginning cold snapshot process
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: INFO nova.compute.manager [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Took 9.81 seconds to build instance.
Nov 15 11:18:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fdf63523-6238-4cd5-a9ab-8f670ad1d75c tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.021s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updated VIF entry in instance network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-29cb00a0-b5c7-444a-a568-707b6b3fa828 req-7ec11b4b-d565-4c55-9aba-ed72fbad05fa service nova] Releasing lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk /opt/stack/data/nova/instances/snapshots/tmpgfin_5eb/c212f08e2be04bad917989f5f3ae78e4 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk /opt/stack/data/nova/instances/snapshots/tmpgfin_5eb/c212f08e2be04bad917989f5f3ae78e4" returned: 0 in 1.000s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Snapshot extracted, beginning image upload
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:44 user nova-compute[76049]: WARNING nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:44 user nova-compute[76049]: WARNING nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:44 user nova-compute[76049]: WARNING nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:44 user nova-compute[76049]: WARNING nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:44 user nova-compute[76049]: WARNING nova.compute.manager [req-f3cd84e1-97fc-4ff6-9c7b-43bc8c593d5b req-9ce645ce-91ff-4d14-b435-66c63cd78f81 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 11:18:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:45 user nova-compute[76049]: INFO nova.compute.manager [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Rebooting instance
Nov 15 11:18:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquired lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Releasing lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-d2ae5af4-2087-497b-8b6d-1c2dabe76fdf req-7afcfe67-09be-44ac-9894-639fbeb30f87 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-unplugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d2ae5af4-2087-497b-8b6d-1c2dabe76fdf req-7afcfe67-09be-44ac-9894-639fbeb30f87 service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d2ae5af4-2087-497b-8b6d-1c2dabe76fdf req-7afcfe67-09be-44ac-9894-639fbeb30f87 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d2ae5af4-2087-497b-8b6d-1c2dabe76fdf req-7afcfe67-09be-44ac-9894-639fbeb30f87 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-d2ae5af4-2087-497b-8b6d-1c2dabe76fdf req-7afcfe67-09be-44ac-9894-639fbeb30f87 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-unplugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:46 user nova-compute[76049]: WARNING nova.compute.manager [req-d2ae5af4-2087-497b-8b6d-1c2dabe76fdf req-7afcfe67-09be-44ac-9894-639fbeb30f87 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received unexpected event network-vif-unplugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 11:18:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Snapshot image upload complete
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.compute.manager [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance destroyed successfully.
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'resources' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-448703032',display_name='tempest-TestMinimumBasicScenario-server-448703032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-448703032',id=25,image_ref='180af431-270d-4091-b0da-1c317715ef45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtW7Pv/CTEQkZolMC1Q4+U0OLBqJDH32lXVA5ecs4bYB6xk4wPqW7BGdAFzo93d9FBWksP5/B0Tougn/WUp0pe1IPRc2Hi/73yasP3KFgqBSySHCk24H19TQRgkJ/PPUw==',key_name='tempest-TestMinimumBasicScenario-622609574',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-fy00h2mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='180af431-270d-4091-b0da-1c317715ef45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:46Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=dc73e2e8-49f8-4c24-a03d-26619b2b5385,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_vif [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36eca79d-0e, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c4cb8d3-34f6-420c-b00d-d5754b654a71) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:47 user nova-compute[76049]: INFO nova.compute.manager [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Shelve offloading
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:47 user nova-compute[76049]: INFO os_vif [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e')
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqbAHVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance destroyed successfully.
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.compute.manager [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquired lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ce8cb6-7bc6-4ee4-91f3-db66e70eeaa7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:18:47 user nova-compute[76049]: No targets found.
Nov 15 11:18:47 user nova-compute[76049]: iSNS:
Nov 15 11:18:47 user nova-compute[76049]: No targets found.
Nov 15 11:18:47 user nova-compute[76049]: STATIC:
Nov 15 11:18:47 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:18:47 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:47 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:47 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:18:47 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:47 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:47 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:18:47 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:47 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:47 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:18:47 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:47 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:47 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:18:47 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:47 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:47 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:18:47 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:18:47 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:18:47 user nova-compute[76049]: FIRMWARE:
Nov 15 11:18:47 user nova-compute[76049]: No targets found.
Nov 15 11:18:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:18:47 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:18:47 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[509997bc-61cd-439f-9b7d-e23b3583b577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd3d4b-fb6c-406c-8d6d-4c77b210c769]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f628456c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855'): ({'sdg'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Removing single pathed devices sdg {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0e4b86-7814-4fa1-9d8b-c8bfcfc23038]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe16f33-8c32-4d78-ba65-e42fac1db14a]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flushing IO for device /dev/sdg {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9bd01-f986-405e-b24f-70587f605ee1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed95367-0624-4179-b802-c67aeef68d5b]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e610a340-3294-4dbf-a5f2-0bdad7031e2b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f333e36-4573-4c32-9183-43bd7340ae22]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]
Nov 15 11:18:47 user nova-compute[76049]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e17c57-d7e4-48f3-bb4f-42daecd4545b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== disconnect_volume: return (395ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Start _get_guest_xml network_info=[{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=180af431-270d-4091-b0da-1c317715ef45,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '180af431-270d-4091-b0da-1c317715ef45'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqbAHVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'dc73e2e8-49f8-4c24-a03d-26619b2b5385', 'attached_at': '', 'detached_at': '', 'volume_id': '1799b425-ccd4-4dc9-a183-022c4b3eb855', 'serial': '1799b425-ccd4-4dc9-a183-022c4b3eb855'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '1a8517b1-3122-4f6a-b8f5-0fc1d5ee5e8d', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:18:47 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:47 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=180af431-270d-4091-b0da-1c317715ef45,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.objects.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Object Instance<dc73e2e8-49f8-4c24-a03d-26619b2b5385> lazy-loaded attributes: resources,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqbAHVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:18:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:18:47 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f1c3a-5643-4864-abe1-09268e3d754b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:18:47 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb7c84c-dd20-458b-bfc8-4a2f3cbd66d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855] added
Nov 15 11:18:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Releasing lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b6f608-a35d-4761-b3c9-7ec63ca0c82b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d2cd3-e125-4faf-b66d-8dcf3c599433]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqbAHVP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqbAHVP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c441b8c-9493-4bdc-bf7a-1492fc90f2a6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWqbAHVP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a182a6eb-61ed-4770-9f4f-55ff8b950376]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2418b036-de5e-4777-90c5-c3ef653ea428]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f6a863-068c-47eb-8df4-74810bbdad96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]
Nov 15 11:18:48 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.
Nov 15 11:18:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e53aa3-dbc0-4d8e-90f8-8050cd3f01eb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3b4de4-c650-44a7-a47e-869ea3286c6a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:18:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bd4cc0-6b51-446c-a109-059b2e2df39a]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqbAHVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:18:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance destroyed successfully.
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.objects.instance [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'resources' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331075314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331075314',id=27,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowPv+zeh5HeWFO2gWyNt655P1rLuxk9JkH05BReuni5hPcufErhaST6j3jqwNsidl8IFiUqJYYff9h02deDf9bJZdZhCLQ4n6wIW3pKPWRiijmwQyhFNj7kfO0p7Dmsg==',key_name='tempest-keypair-1390670603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-a30rqbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member',shelved_at='2023-11-15T11:18:47.299257',shelved_host='user',shelved_image_id='e1072e98-00d9-4d4c-b317-54a984764ae8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG os_vif [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3681d118-30, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09ced5ec-f11c-412b-b104-155af25736bb) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing instance network info cache due to event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] Acquiring lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] Acquired lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.network.neutron [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:48 user nova-compute[76049]: INFO os_vif [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30')
Nov 15 11:18:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Deleting instance files /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc_del
Nov 15 11:18:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Deletion of /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc_del complete
Nov 15 11:18:48 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Deleted allocations for instance 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.objects.instance [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'numa_topology' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:48 user nova-compute[76049]: DEBUG nova.objects.base [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc> lazy-loaded attributes: resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-d740e601-f61d-43b1-8443-3a27c6c8c851 req-0c388072-a5e1-4e9e-a6ec-a4f3e6826e1c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d740e601-f61d-43b1-8443-3a27c6c8c851 req-0c388072-a5e1-4e9e-a6ec-a4f3e6826e1c service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d740e601-f61d-43b1-8443-3a27c6c8c851 req-0c388072-a5e1-4e9e-a6ec-a4f3e6826e1c service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d740e601-f61d-43b1-8443-3a27c6c8c851 req-0c388072-a5e1-4e9e-a6ec-a4f3e6826e1c service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-d740e601-f61d-43b1-8443-3a27c6c8c851 req-0c388072-a5e1-4e9e-a6ec-a4f3e6826e1c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:49 user nova-compute[76049]: WARNING nova.compute.manager [req-d740e601-f61d-43b1-8443-3a27c6c8c851 req-0c388072-a5e1-4e9e-a6ec-a4f3e6826e1c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received unexpected event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.network.neutron [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updated VIF entry in instance network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.network.neutron [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3681d118-30", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3cd244a5-8e75-46aa-9771-51d177a06444 req-88497887-1fcf-4bf6-b1c8-ac62928c24eb service nova] Releasing lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23631346136613539', 'path': '/dev/sdg'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346136613539', 'path': '/dev/sdg'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-448703032',display_name='tempest-TestMinimumBasicScenario-server-448703032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-448703032',id=25,image_ref='180af431-270d-4091-b0da-1c317715ef45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtW7Pv/CTEQkZolMC1Q4+U0OLBqJDH32lXVA5ecs4bYB6xk4wPqW7BGdAFzo93d9FBWksP5/B0Tougn/WUp0pe1IPRc2Hi/73yasP3KFgqBSySHCk24H19TQRgkJ/PPUw==',key_name='tempest-TestMinimumBasicScenario-622609574',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-fy00h2mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='180af431-270d-4091-b0da-1c317715ef45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:46Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=dc73e2e8-49f8-4c24-a03d-26619b2b5385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'pci_devices' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.objects.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Object Instance<dc73e2e8-49f8-4c24-a03d-26619b2b5385> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:18:49 user nova-compute[76049]:   <uuid>dc73e2e8-49f8-4c24-a03d-26619b2b5385</uuid>
Nov 15 11:18:49 user nova-compute[76049]:   <name>instance-00000019</name>
Nov 15 11:18:49 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:18:49 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:18:49 user nova-compute[76049]:   <metadata>
Nov 15 11:18:49 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:18:49 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:18:49 user nova-compute[76049]:       <nova:name>tempest-TestMinimumBasicScenario-server-448703032</nova:name>
Nov 15 11:18:49 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:18:47</nova:creationTime>
Nov 15 11:18:49 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:18:49 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:18:49 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:18:49 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:18:49 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:18:49 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:18:49 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:18:49 user nova-compute[76049]:       <nova:owner>
Nov 15 11:18:49 user nova-compute[76049]:         <nova:user uuid="9846cdf834fe438e822035561c81d2d8">tempest-TestMinimumBasicScenario-739422793-project-member</nova:user>
Nov 15 11:18:49 user nova-compute[76049]:         <nova:project uuid="78d017cbd24f46a9b371b9ba33dd9abb">tempest-TestMinimumBasicScenario-739422793</nova:project>
Nov 15 11:18:49 user nova-compute[76049]:       </nova:owner>
Nov 15 11:18:49 user nova-compute[76049]:       <nova:root type="image" uuid="180af431-270d-4091-b0da-1c317715ef45"/>
Nov 15 11:18:49 user nova-compute[76049]:       <nova:ports>
Nov 15 11:18:49 user nova-compute[76049]:         <nova:port uuid="36eca79d-0ee1-4fce-86a4-ac47c7c0d896">
Nov 15 11:18:49 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 11:18:49 user nova-compute[76049]:         </nova:port>
Nov 15 11:18:49 user nova-compute[76049]:       </nova:ports>
Nov 15 11:18:49 user nova-compute[76049]:     </nova:instance>
Nov 15 11:18:49 user nova-compute[76049]:   </metadata>
Nov 15 11:18:49 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:18:49 user nova-compute[76049]:     <system>
Nov 15 11:18:49 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:18:49 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:18:49 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:18:49 user nova-compute[76049]:       <entry name="serial">dc73e2e8-49f8-4c24-a03d-26619b2b5385</entry>
Nov 15 11:18:49 user nova-compute[76049]:       <entry name="uuid">dc73e2e8-49f8-4c24-a03d-26619b2b5385</entry>
Nov 15 11:18:49 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:18:49 user nova-compute[76049]:     </system>
Nov 15 11:18:49 user nova-compute[76049]:   </sysinfo>
Nov 15 11:18:49 user nova-compute[76049]:   <os>
Nov 15 11:18:49 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:18:49 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:18:49 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:18:49 user nova-compute[76049]:   </os>
Nov 15 11:18:49 user nova-compute[76049]:   <features>
Nov 15 11:18:49 user nova-compute[76049]:     <acpi/>
Nov 15 11:18:49 user nova-compute[76049]:     <apic/>
Nov 15 11:18:49 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:18:49 user nova-compute[76049]:   </features>
Nov 15 11:18:49 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:18:49 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:18:49 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:18:49 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:18:49 user nova-compute[76049]:   </clock>
Nov 15 11:18:49 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:18:49 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:18:49 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:18:49 user nova-compute[76049]:   </cpu>
Nov 15 11:18:49 user nova-compute[76049]:   <devices>
Nov 15 11:18:49 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:18:49 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:18:49 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk"/>
Nov 15 11:18:49 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:18:49 user nova-compute[76049]:     </disk>
Nov 15 11:18:49 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:18:49 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:18:49 user nova-compute[76049]:       <source dev="/dev/sdg"/>
Nov 15 11:18:49 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:18:49 user nova-compute[76049]:       <serial>1799b425-ccd4-4dc9-a183-022c4b3eb855</serial>
Nov 15 11:18:49 user nova-compute[76049]:     </disk>
Nov 15 11:18:49 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:18:49 user nova-compute[76049]:       <mac address="fa:16:3e:11:f9:3e"/>
Nov 15 11:18:49 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:49 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:18:49 user nova-compute[76049]:       <target dev="tap36eca79d-0e"/>
Nov 15 11:18:49 user nova-compute[76049]:     </interface>
Nov 15 11:18:49 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:18:49 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/console.log" append="off"/>
Nov 15 11:18:49 user nova-compute[76049]:     </serial>
Nov 15 11:18:49 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:18:49 user nova-compute[76049]:     <video>
Nov 15 11:18:49 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:18:49 user nova-compute[76049]:     </video>
Nov 15 11:18:49 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:18:49 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:18:49 user nova-compute[76049]:     </rng>
Nov 15 11:18:49 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:18:49 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:18:49 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:18:49 user nova-compute[76049]:     </memballoon>
Nov 15 11:18:49 user nova-compute[76049]:   </devices>
Nov 15 11:18:49 user nova-compute[76049]: </domain>
Nov 15 11:18:49 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-344a62ac-2eef-4e1d-8722-c6b91317b02b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.308s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.objects.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Object Instance<dc73e2e8-49f8-4c24-a03d-26619b2b5385> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:18:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Cannot resize image /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'migration_context' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG nova.objects.base [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Object Instance<dc73e2e8-49f8-4c24-a03d-26619b2b5385> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-448703032',display_name='tempest-TestMinimumBasicScenario-server-448703032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-448703032',id=25,image_ref='180af431-270d-4091-b0da-1c317715ef45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtW7Pv/CTEQkZolMC1Q4+U0OLBqJDH32lXVA5ecs4bYB6xk4wPqW7BGdAFzo93d9FBWksP5/B0Tougn/WUp0pe1IPRc2Hi/73yasP3KFgqBSySHCk24H19TQRgkJ/PPUw==',key_name='tempest-TestMinimumBasicScenario-622609574',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-fy00h2mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='180af431-270d-4091-b0da-1c317715ef45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:18:46Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=dc73e2e8-49f8-4c24-a03d-26619b2b5385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG os_vif [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f449bc7-a7f2-5e83-a8fe-85b05e775237', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36eca79d-0e, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36eca79d-0e, col_values=(('qos', UUID('bc81c589-9933-42f8-a99e-7b9d9d933c74')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36eca79d-0e, col_values=(('external_ids', {'iface-id': '36eca79d-0ee1-4fce-86a4-ac47c7c0d896', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:f9:3e', 'vm-uuid': 'dc73e2e8-49f8-4c24-a03d-26619b2b5385'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:18:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:50 user nova-compute[76049]: INFO os_vif [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e')
Nov 15 11:18:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-5245d07f-1d0f-422e-b6cf-3eae74cf39f8 req-0e60668d-0596-4035-a0c9-410489ed9510 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5245d07f-1d0f-422e-b6cf-3eae74cf39f8 req-0e60668d-0596-4035-a0c9-410489ed9510 service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5245d07f-1d0f-422e-b6cf-3eae74cf39f8 req-0e60668d-0596-4035-a0c9-410489ed9510 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5245d07f-1d0f-422e-b6cf-3eae74cf39f8 req-0e60668d-0596-4035-a0c9-410489ed9510 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-5245d07f-1d0f-422e-b6cf-3eae74cf39f8 req-0e60668d-0596-4035-a0c9-410489ed9510 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:52 user nova-compute[76049]: WARNING nova.compute.manager [req-5245d07f-1d0f-422e-b6cf-3eae74cf39f8 req-0e60668d-0596-4035-a0c9-410489ed9510 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received unexpected event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 11:18:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:18:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance rebooted successfully.
Nov 15 11:18:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:18:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c3d6a111-2f3e-47a2-822e-8ff1b32173db tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.343s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-e4cae197-602f-4306-98d7-21cdfac83162 req-ac15de6c-0d2d-4c9d-a818-0473854d6de2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:18:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e4cae197-602f-4306-98d7-21cdfac83162 req-ac15de6c-0d2d-4c9d-a818-0473854d6de2 service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:18:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e4cae197-602f-4306-98d7-21cdfac83162 req-ac15de6c-0d2d-4c9d-a818-0473854d6de2 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:18:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e4cae197-602f-4306-98d7-21cdfac83162 req-ac15de6c-0d2d-4c9d-a818-0473854d6de2 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:18:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-e4cae197-602f-4306-98d7-21cdfac83162 req-ac15de6c-0d2d-4c9d-a818-0473854d6de2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:18:54 user nova-compute[76049]: WARNING nova.compute.manager [req-e4cae197-602f-4306-98d7-21cdfac83162 req-ac15de6c-0d2d-4c9d-a818-0473854d6de2 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received unexpected event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with vm_state active and task_state None.
Nov 15 11:18:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:18:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-changed-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Refreshing instance network info cache due to event network-changed-3a61161e-500e-48da-bd40-d35b8b88a4f7. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] Acquiring lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] Acquired lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Refreshing network info cache for port 3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updated VIF entry in instance network info cache for port 3a61161e-500e-48da-bd40-d35b8b88a4f7. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updating instance_info_cache with network_info: [{"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:19:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2b526a44-0ff7-4b05-9590-55f3f0d662ff req-a8fb2b93-1894-48be-bffe-d11bfdbabc74 service nova] Releasing lock "refresh_cache-fe8b1a44-b45b-454f-bfdc-78dd9fea5706" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:19:03 user nova-compute[76049]: INFO nova.compute.manager [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Unrescuing
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'flavor' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:03 user nova-compute[76049]: INFO nova.compute.manager [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Attaching volume 33bee106-deee-4005-971c-86b40962e3b5 to /dev/vdb
Nov 15 11:19:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating instance_info_cache with network_info: [{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG os_brick.utils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'flavor' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff44c26-8a55-4333-81ab-7ebe63e71fe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4e2c25-b631-478a-b65a-965de1047318]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e8c133-8dcb-424e-bb50-d86f81c64b5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a057ade8-d2af-41c1-a2cf-a63a6f60231d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:03 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c7e76-0e45-42a6-9b1c-fd0da2d43fdc]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG os_brick.utils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updating existing volume attachment record: dcdda0f9-5b71-4395-a8d5-f60eb5d68a99 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-97e39e09-1793-439d-abdd-8a2cb48b25cf req-1edc888b-697f-427a-b484-61c40dce8452 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-97e39e09-1793-439d-abdd-8a2cb48b25cf req-1edc888b-697f-427a-b484-61c40dce8452 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-97e39e09-1793-439d-abdd-8a2cb48b25cf req-1edc888b-697f-427a-b484-61c40dce8452 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-97e39e09-1793-439d-abdd-8a2cb48b25cf req-1edc888b-697f-427a-b484-61c40dce8452 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-97e39e09-1793-439d-abdd-8a2cb48b25cf req-1edc888b-697f-427a-b484-61c40dce8452 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:03 user nova-compute[76049]: WARNING nova.compute.manager [req-97e39e09-1793-439d-abdd-8a2cb48b25cf req-1edc888b-697f-427a-b484-61c40dce8452 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:19:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:04 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance destroyed successfully.
Nov 15 11:19:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:05 user nova-compute[76049]: WARNING nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:05 user nova-compute[76049]: WARNING nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:05 user nova-compute[76049]: WARNING nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:05 user nova-compute[76049]: WARNING nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:05 user nova-compute[76049]: WARNING nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:05 user nova-compute[76049]: WARNING nova.compute.manager [req-d40ed562-8e29-4821-b167-e83e41c0257f req-c027aa95-5b9a-4330-9eca-065a2710ffc3 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:19:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d60d2a1f-16f0-4233-8d82-c291a406e580 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:19:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-612328d4-ec38-4612-9221-a6ca684df647 req-27354b22-5331-4d35-a48c-5befcf49000c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-612328d4-ec38-4612-9221-a6ca684df647 req-27354b22-5331-4d35-a48c-5befcf49000c service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-612328d4-ec38-4612-9221-a6ca684df647 req-27354b22-5331-4d35-a48c-5befcf49000c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-612328d4-ec38-4612-9221-a6ca684df647 req-27354b22-5331-4d35-a48c-5befcf49000c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-612328d4-ec38-4612-9221-a6ca684df647 req-27354b22-5331-4d35-a48c-5befcf49000c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:07 user nova-compute[76049]: WARNING nova.compute.manager [req-612328d4-ec38-4612-9221-a6ca684df647 req-27354b22-5331-4d35-a48c-5befcf49000c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state active and task_state None.
Nov 15 11:19:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZsTxbdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:19:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:19:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:08 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:19:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8795122f-50af-4e86-bd40-6f4f172927a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:19:08 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c85206c-5410-41fe-9bb1-b4d0dfed7d7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5] added
Nov 15 11:19:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[533487c6-1d8e-47b5-9059-a4b50bb727ae]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a151ff6-9a57-4773-bdfa-52896b14a98b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZsTxbdo {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZsTxbdo" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ac55f0-1b6a-483f-8830-09264b79cae7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CZsTxbdo'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b226a42-f0df-4d80-ac19-116ea1972566]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[969bbb4a-737e-4ad6-a0d2-fc0c2657f87e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a43406-b4b1-4f78-a3c1-3de578d941f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260]
Nov 15 11:19:09 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260] successful.
Nov 15 11:19:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2af7b8-f11f-49f6-a583-312ff1a68135]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950e20d-7690-4934-8221-ece0b5b3725c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] HCTL ('39', '-', '-', 0) found on session 34 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[de263be4-b3cb-4f71-9e2e-10e1b80ae62d]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: None {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZsTxbdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23930636637643661', 'path': '/dev/sdh'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930636637643661', 'path': '/dev/sdh'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'flavor' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:19:10 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:19:10 user nova-compute[76049]:   <source dev="/dev/sdh"/>
Nov 15 11:19:10 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:19:10 user nova-compute[76049]:   <serial>33bee106-deee-4005-971c-86b40962e3b5</serial>
Nov 15 11:19:10 user nova-compute[76049]: </disk>
Nov 15 11:19:10 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No VIF found with MAC fa:16:3e:e9:bb:29, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-changed-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Refreshing instance network info cache due to event network-changed-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] Acquiring lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] Acquired lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG nova.network.neutron [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Refreshing network info cache for port 106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:19:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d71dbf53-1d0f-4ebc-a2b3-ca3cf83f83ae tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.412s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updated VIF entry in instance network info cache for port 106fa0fd-82a1-49f2-a0f8-35cc9c49ec31. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updating instance_info_cache with network_info: [{"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-baed9316-7c13-4f2e-ba07-7eb6172aedc9 req-53a42ba5-e959-44a4-a949-1648a344b9a6 service nova] Releasing lock "refresh_cache-24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'flavor' on Instance uuid 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:11 user nova-compute[76049]: INFO nova.compute.manager [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Attaching volume 67d0eb55-f1ad-403d-b387-cb5788104926 to /dev/vdb
Nov 15 11:19:11 user nova-compute[76049]: DEBUG os_brick.utils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce8c9c-97fc-443b-bdc9-ae03a5cc3909]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b036fa4-4459-4a4f-8376-bf651ebb6e8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[76989f2d-cde1-43f8-a82a-8a1195fba2dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6124edb5-13e7-4cc8-baf8-eea705655467]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:11 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:19:11 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ced3c3-f12e-4cd7-9cc0-4545e626239d]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG os_brick.utils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:11 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updating existing volume attachment record: 8a9c86d1-3920-4b81-831f-dfb57d94d6c2 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:19:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'flavor' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:13 user nova-compute[76049]: INFO nova.compute.manager [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Attaching volume c7c758cf-ea8a-46cd-a760-19efa04365d4 to /dev/vdc
Nov 15 11:19:13 user nova-compute[76049]: DEBUG os_brick.utils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8691549c-b453-4083-8c0a-1f95728f2206]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f9e5bd-a000-41ee-8057-5be9b42cb77e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6fcc9e-6265-45d4-acad-97399ec53aae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d471984-9829-4a77-ab43-19f1a34744a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:14 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:19:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed55001-b91a-4f6a-8a9d-977510ba69d1]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG os_brick.utils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:14 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updating existing volume attachment record: 900ec289-80e7-4b29-aa0f-2d9ec96c0203 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:19:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:16 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a725ce-22b4-4ba3-b054-e60b4bd58dc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:19:16 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5b746-835f-4fed-b660-e22b63236427]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926] added
Nov 15 11:19:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59e3d00-c215-4ca5-8247-09917647b8e2]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[95844dbd-cb1d-4f05-a2ab-4ca05772329b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDUJFpS {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDUJFpS" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5369c45-e847-4d6a-9da6-af062cf62e1f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzDUJFpS'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03bf633-8841-4095-af0e-965cb0cf08cd]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccf46e7-fe8b-481f-916a-6fce92d08225]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d964f-9c91-4992-beee-5b30dc4259ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]
Nov 15 11:19:17 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.
Nov 15 11:19:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c966ceb9-9864-4382-8d2e-ed92a7ac3e26]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0593ef6c-9559-43ff-ac66-3b04eb7e719a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] HCTL ('40', '-', '-', 0) found on session 35 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbacfb2a-ed12-44db-83d0-d97aa3dba3a9]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching for a device in session 35 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:19:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23631393435326138', 'path': '/dev/sdi'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631393435326138', 'path': '/dev/sdi'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'flavor' on Instance uuid 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:19:18 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:19:18 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:19:18 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:19:18 user nova-compute[76049]:   <serial>67d0eb55-f1ad-403d-b387-cb5788104926</serial>
Nov 15 11:19:18 user nova-compute[76049]: </disk>
Nov 15 11:19:18 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No VIF found with MAC fa:16:3e:67:a7:79, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ac365146-6f14-4117-b031-cf0bf5cb5445 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.173s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOLDJcnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:18 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:19:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:18 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:19:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:18 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:19:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b538e-b37f-4f54-b226-adbc2c344bf1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:19:19 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cea350-6af8-4e71-98a5-cb3fc8d795ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4] added
Nov 15 11:19:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1be161d-b749-40fd-9498-8b4e2c3d3f7e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c5b25-9ac3-4cdb-b609-a28a6af229b7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOLDJcnB {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOLDJcnB" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cbdcdb-0c93-4473-b674-e77e20e1bc6b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tOLDJcnB'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf62665-8253-4a42-ad0f-254bf5d5abdb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[45315a99-5aa5-4810-9c09-64582a1163d4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0ea23-deb4-4507-9050-b19ab8ee5847]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260]
Nov 15 11:19:19 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260] successful.
Nov 15 11:19:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9879f-f2ad-4bb6-9c96-9262936e96ab]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[258bdb66-cb8d-44eb-9b7b-8a4202f7c6ee]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] HCTL ('41', '-', '-', 0) found on session 36 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f9965-481f-4655-94db-7b4f37e72e54]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Searching for a device in session 36 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOLDJcnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:19:19 user nova-compute[76049]: INFO nova.compute.manager [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Rebuilding instance
Nov 15 11:19:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:19:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-7d6555cc-074e-4828-a881-23286ad97669 req-2d5654a9-4d18-409d-a37c-bfc401279f63 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-unplugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7d6555cc-074e-4828-a881-23286ad97669 req-2d5654a9-4d18-409d-a37c-bfc401279f63 service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7d6555cc-074e-4828-a881-23286ad97669 req-2d5654a9-4d18-409d-a37c-bfc401279f63 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7d6555cc-074e-4828-a881-23286ad97669 req-2d5654a9-4d18-409d-a37c-bfc401279f63 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-7d6555cc-074e-4828-a881-23286ad97669 req-2d5654a9-4d18-409d-a37c-bfc401279f63 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-unplugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:20 user nova-compute[76049]: WARNING nova.compute.manager [req-7d6555cc-074e-4828-a881-23286ad97669 req-2d5654a9-4d18-409d-a37c-bfc401279f63 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received unexpected event network-vif-unplugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with vm_state active and task_state rebuilding.
Nov 15 11:19:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23631333265386162', 'path': '/dev/sdj'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631333265386162', 'path': '/dev/sdj'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'flavor' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:19:20 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:19:20 user nova-compute[76049]:   <source dev="/dev/sdj"/>
Nov 15 11:19:20 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:19:20 user nova-compute[76049]:   <serial>c7c758cf-ea8a-46cd-a760-19efa04365d4</serial>
Nov 15 11:19:20 user nova-compute[76049]: </disk>
Nov 15 11:19:20 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:19:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance destroyed successfully.
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] No VIF found with MAC fa:16:3e:e9:bb:29, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:19:21 user nova-compute[76049]: INFO nova.compute.manager [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Detaching volume 67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:19:21 user nova-compute[76049]: INFO nova.virt.block_device [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Attempting to driver detach volume 67d0eb55-f1ad-403d-b387-cb5788104926 from mountpoint /dev/vdb
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Attempting to detach device vdb from instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:19:21 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:19:21 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:19:21 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:19:21 user nova-compute[76049]:   <serial>67d0eb55-f1ad-403d-b387-cb5788104926</serial>
Nov 15 11:19:21 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:19:21 user nova-compute[76049]: </disk>
Nov 15 11:19:21 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fcc38cd7-c92f-48a2-bb6e-278d50a5365d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.322s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully detached device vdb from instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa from the persistent domain config.
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:21 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbbedae-62c7-479b-a8bb-ce0c99e5056b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:19:21 user nova-compute[76049]: No targets found.
Nov 15 11:19:21 user nova-compute[76049]: iSNS:
Nov 15 11:19:21 user nova-compute[76049]: No targets found.
Nov 15 11:19:21 user nova-compute[76049]: STATIC:
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:19:21 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:21 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:21 user nova-compute[76049]: FIRMWARE:
Nov 15 11:19:21 user nova-compute[76049]: No targets found.
Nov 15 11:19:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:19:21 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:19:21 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d9f9ab-9320-4266-b387-917da7dd6d51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5077d3c-2bf3-4b02-b8ec-62d80973f069]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629f0244c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926'): ({'sdi'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Removing single pathed devices sdi {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae35507-2455-4c90-a8e3-e2e4838925c4]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f698b47a-aa21-4e0d-a24a-475e8cc1010f]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flushing IO for device /dev/sdi {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad69bf6-f2d7-46b7-bb5f-87c9f12bc603]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef2ca44-438c-408d-a1cf-e33e062789c8]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[16286405-2353-43e5-b42f-e3ca6a4daa5a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7768b0-cf94-468e-88f3-70a0dc2b3e0f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]
Nov 15 11:19:21 user nova-compute[76049]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.
Nov 15 11:19:21 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7209fe94-6602-4325-8292-c060a6433fbc]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== disconnect_volume: return (329ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:21 user nova-compute[76049]: INFO nova.compute.manager [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Detaching volume c7c758cf-ea8a-46cd-a760-19efa04365d4
Nov 15 11:19:21 user nova-compute[76049]: INFO nova.virt.block_device [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Attempting to driver detach volume c7c758cf-ea8a-46cd-a760-19efa04365d4 from mountpoint /dev/vdc
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Attempting to detach device vdc from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:19:21 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:19:21 user nova-compute[76049]:   <source dev="/dev/sdj"/>
Nov 15 11:19:21 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:19:21 user nova-compute[76049]:   <serial>c7c758cf-ea8a-46cd-a760-19efa04365d4</serial>
Nov 15 11:19:21 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 11:19:21 user nova-compute[76049]: </disk>
Nov 15 11:19:21 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:19:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Successfully detached device vdc from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the persistent domain config.
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:19:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:19:21 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:19:21 user nova-compute[76049]:   <source dev="/dev/sdj"/>
Nov 15 11:19:21 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:19:21 user nova-compute[76049]:   <serial>c7c758cf-ea8a-46cd-a760-19efa04365d4</serial>
Nov 15 11:19:21 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 11:19:21 user nova-compute[76049]: </disk>
Nov 15 11:19:21 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-21a4f1b9-0585-4bd1-b051-bd2557904a5d req-adf4d5d2-5d6c-4c4e-9517-c0660015dd64 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-21a4f1b9-0585-4bd1-b051-bd2557904a5d req-adf4d5d2-5d6c-4c4e-9517-c0660015dd64 service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-21a4f1b9-0585-4bd1-b051-bd2557904a5d req-adf4d5d2-5d6c-4c4e-9517-c0660015dd64 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-21a4f1b9-0585-4bd1-b051-bd2557904a5d req-adf4d5d2-5d6c-4c4e-9517-c0660015dd64 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-21a4f1b9-0585-4bd1-b051-bd2557904a5d req-adf4d5d2-5d6c-4c4e-9517-c0660015dd64 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:22 user nova-compute[76049]: WARNING nova.compute.manager [req-21a4f1b9-0585-4bd1-b051-bd2557904a5d req-adf4d5d2-5d6c-4c4e-9517-c0660015dd64 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received unexpected event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with vm_state active and task_state rebuilding.
Nov 15 11:19:22 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance destroyed successfully.
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-629386612',display_name='tempest-ServerActionsTestOtherA-server-1932880119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-629386612',id=29,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdfw8Vhn8HmFUxs4uQBERoBTqPeLBl7Un+FuADAkStah/A1RlP/97OuP2PrMkPLvhz7jjAvT72k+haEZtzLpKYwmYQP/3EEIX5nmnAAZc/QHHdaPJIknGNQRE+WnywtGQ==',key_name='tempest-keypair-1985050702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-ovhgk6k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:19:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_vif [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap106fa0fd-82, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fcce4cc-05ed-4b8a-9bec-0bfac4f519e8) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:22 user nova-compute[76049]: INFO os_vif [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82')
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:22 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9094343c-fe9b-411c-9c43-9c0acbd84014]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:19:22 user nova-compute[76049]: No targets found.
Nov 15 11:19:22 user nova-compute[76049]: iSNS:
Nov 15 11:19:22 user nova-compute[76049]: No targets found.
Nov 15 11:19:22 user nova-compute[76049]: STATIC:
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:19:22 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:22 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:22 user nova-compute[76049]: FIRMWARE:
Nov 15 11:19:22 user nova-compute[76049]: No targets found.
Nov 15 11:19:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:19:22 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:19:22 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[990c4b85-8463-4e69-8fc5-8b2597671d5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8800b87-43db-448b-841e-abed3b68e0ad]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62847d55a0>, {}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Disconnecting from: [] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== disconnect_volume: return (81ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:19:22 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Deleting instance files /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa_del
Nov 15 11:19:22 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Deletion of /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa_del complete
Nov 15 11:19:22 user nova-compute[76049]: INFO nova.virt.block_device [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Booting with volume 67d0eb55-f1ad-403d-b387-cb5788104926 at /dev/vdb
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.utils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c6a3ee-101b-4f04-ba92-b7efe2aa09da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[328062dd-3036-4773-9a1a-c9d00443e3a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7516c6-05e9-48b0-a2b1-583ba1800534]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8ee5f5-33f4-4ed6-b4f9-226a042c8bc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:19:22 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:19:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cbf463-5f48-4825-90aa-7ad32916add1]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG os_brick.utils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updating existing volume attachment record: 935177be-65d1-4247-9bd1-8be40370dfb5 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:19:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:19:27 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Creating image(s)
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.203s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk 1073741824" returned: 0 in 0.057s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.225s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Cannot resize image /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Ensure instance console log exists: /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Start _get_guest_xml network_info=[{"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa', 'attached_at': '', 'detached_at': '', 'volume_id': '67d0eb55-f1ad-403d-b387-cb5788104926', 'serial': '67d0eb55-f1ad-403d-b387-cb5788104926'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '935177be-65d1-4247-9bd1-8be40370dfb5', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:19:28 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 11:19:28 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:28 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:28 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:28 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[52965971-6762-4a59-a293-3604f758c83e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:19:28 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[533bb218-5964-4b9c-89b4-bce302f2729d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926] added
Nov 15 11:19:28 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc5532-b6c3-4095-b12b-85e807e3efcc]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a53f7f-f776-4ae8-9b67-d7773a224881]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDUJFpS {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDUJFpS" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[460dc86a-c09b-49d8-b283-5f83ca97f034]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzDUJFpS'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef2a45-6bfa-4ec8-97d1-9d80127c7b55]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb0d838-529d-4b2c-aa77-5155bbc6eefd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b873efbc-2a4e-480c-8b06-a4198c4730fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]
Nov 15 11:19:29 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.
Nov 15 11:19:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1a6522-1f9b-474c-b6bb-797574aec6fa]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50de6ef-5cd3-4631-8a25-f49db53b69a2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] HCTL ('40', '-', '-', 0) found on session 37 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b8bed-87ea-40c0-946c-582f89ab3361]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching for a device in session 37 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23631393435326138', 'path': '/dev/sdi'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631393435326138', 'path': '/dev/sdi'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-629386612',display_name='tempest-ServerActionsTestOtherA-server-1932880119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-629386612',id=29,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdfw8Vhn8HmFUxs4uQBERoBTqPeLBl7Un+FuADAkStah/A1RlP/97OuP2PrMkPLvhz7jjAvT72k+haEZtzLpKYwmYQP/3EEIX5nmnAAZc/QHHdaPJIknGNQRE+WnywtGQ==',key_name='tempest-keypair-1985050702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-ovhgk6k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:19:30 user nova-compute[76049]:   <uuid>24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa</uuid>
Nov 15 11:19:30 user nova-compute[76049]:   <name>instance-0000001d</name>
Nov 15 11:19:30 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:19:30 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:19:30 user nova-compute[76049]:   <metadata>
Nov 15 11:19:30 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:19:30 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:19:30 user nova-compute[76049]:       <nova:name>tempest-ServerActionsTestOtherA-server-1932880119</nova:name>
Nov 15 11:19:30 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:19:28</nova:creationTime>
Nov 15 11:19:30 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:19:30 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:19:30 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:19:30 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:19:30 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:19:30 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:19:30 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:19:30 user nova-compute[76049]:       <nova:owner>
Nov 15 11:19:30 user nova-compute[76049]:         <nova:user uuid="c548eac583644342a905b89ee8fc4b1a">tempest-ServerActionsTestOtherA-278593450-project-member</nova:user>
Nov 15 11:19:30 user nova-compute[76049]:         <nova:project uuid="a61718ae918a495eadf79664d2ea66c6">tempest-ServerActionsTestOtherA-278593450</nova:project>
Nov 15 11:19:30 user nova-compute[76049]:       </nova:owner>
Nov 15 11:19:30 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:19:30 user nova-compute[76049]:       <nova:ports>
Nov 15 11:19:30 user nova-compute[76049]:         <nova:port uuid="106fa0fd-82a1-49f2-a0f8-35cc9c49ec31">
Nov 15 11:19:30 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 11:19:30 user nova-compute[76049]:         </nova:port>
Nov 15 11:19:30 user nova-compute[76049]:       </nova:ports>
Nov 15 11:19:30 user nova-compute[76049]:     </nova:instance>
Nov 15 11:19:30 user nova-compute[76049]:   </metadata>
Nov 15 11:19:30 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:19:30 user nova-compute[76049]:     <system>
Nov 15 11:19:30 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:19:30 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:19:30 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:19:30 user nova-compute[76049]:       <entry name="serial">24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa</entry>
Nov 15 11:19:30 user nova-compute[76049]:       <entry name="uuid">24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa</entry>
Nov 15 11:19:30 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:19:30 user nova-compute[76049]:     </system>
Nov 15 11:19:30 user nova-compute[76049]:   </sysinfo>
Nov 15 11:19:30 user nova-compute[76049]:   <os>
Nov 15 11:19:30 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:19:30 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:19:30 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:19:30 user nova-compute[76049]:   </os>
Nov 15 11:19:30 user nova-compute[76049]:   <features>
Nov 15 11:19:30 user nova-compute[76049]:     <acpi/>
Nov 15 11:19:30 user nova-compute[76049]:     <apic/>
Nov 15 11:19:30 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:19:30 user nova-compute[76049]:   </features>
Nov 15 11:19:30 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:19:30 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:19:30 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:19:30 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:19:30 user nova-compute[76049]:   </clock>
Nov 15 11:19:30 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:19:30 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:19:30 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:19:30 user nova-compute[76049]:   </cpu>
Nov 15 11:19:30 user nova-compute[76049]:   <devices>
Nov 15 11:19:30 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:19:30 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:19:30 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk"/>
Nov 15 11:19:30 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:19:30 user nova-compute[76049]:     </disk>
Nov 15 11:19:30 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:19:30 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:19:30 user nova-compute[76049]:       <source dev="/dev/sdi"/>
Nov 15 11:19:30 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:19:30 user nova-compute[76049]:       <serial>67d0eb55-f1ad-403d-b387-cb5788104926</serial>
Nov 15 11:19:30 user nova-compute[76049]:     </disk>
Nov 15 11:19:30 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:19:30 user nova-compute[76049]:       <mac address="fa:16:3e:67:a7:79"/>
Nov 15 11:19:30 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:19:30 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:19:30 user nova-compute[76049]:       <target dev="tap106fa0fd-82"/>
Nov 15 11:19:30 user nova-compute[76049]:     </interface>
Nov 15 11:19:30 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:19:30 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/console.log" append="off"/>
Nov 15 11:19:30 user nova-compute[76049]:     </serial>
Nov 15 11:19:30 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:19:30 user nova-compute[76049]:     <video>
Nov 15 11:19:30 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:19:30 user nova-compute[76049]:     </video>
Nov 15 11:19:30 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:19:30 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:19:30 user nova-compute[76049]:     </rng>
Nov 15 11:19:30 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:19:30 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:19:30 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:19:30 user nova-compute[76049]:     </memballoon>
Nov 15 11:19:30 user nova-compute[76049]:   </devices>
Nov 15 11:19:30 user nova-compute[76049]: </domain>
Nov 15 11:19:30 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-629386612',display_name='tempest-ServerActionsTestOtherA-server-1932880119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-629386612',id=29,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdfw8Vhn8HmFUxs4uQBERoBTqPeLBl7Un+FuADAkStah/A1RlP/97OuP2PrMkPLvhz7jjAvT72k+haEZtzLpKYwmYQP/3EEIX5nmnAAZc/QHHdaPJIknGNQRE+WnywtGQ==',key_name='tempest-keypair-1985050702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-ovhgk6k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG os_vif [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4679596-201f-5f0a-a3c2-4c7582bfb5e2', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap106fa0fd-82, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap106fa0fd-82, col_values=(('qos', UUID('b0db411f-eee8-4797-a0ae-72f64a4e3f02')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap106fa0fd-82, col_values=(('external_ids', {'iface-id': '106fa0fd-82a1-49f2-a0f8-35cc9c49ec31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:a7:79', 'vm-uuid': '24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:30 user nova-compute[76049]: INFO os_vif [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82')
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No VIF found with MAC fa:16:3e:67:a7:79, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-54791f85-507b-410d-9fc5-ead9db303971 req-cdaa3b53-347a-4f03-8907-b14122012a6c service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-54791f85-507b-410d-9fc5-ead9db303971 req-cdaa3b53-347a-4f03-8907-b14122012a6c service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-54791f85-507b-410d-9fc5-ead9db303971 req-cdaa3b53-347a-4f03-8907-b14122012a6c service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-54791f85-507b-410d-9fc5-ead9db303971 req-cdaa3b53-347a-4f03-8907-b14122012a6c service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-54791f85-507b-410d-9fc5-ead9db303971 req-cdaa3b53-347a-4f03-8907-b14122012a6c service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:31 user nova-compute[76049]: WARNING nova.compute.manager [req-54791f85-507b-410d-9fc5-ead9db303971 req-cdaa3b53-347a-4f03-8907-b14122012a6c service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received unexpected event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:19:33 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:19:33 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=6886MB free_disk=25.007339477539062GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:33 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance spawned successfully.
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f571b12-5573-459a-ad19-5f6fd9723368 req-b4d100f8-4584-4de6-bf49-b1c650e7a6c2 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f571b12-5573-459a-ad19-5f6fd9723368 req-b4d100f8-4584-4de6-bf49-b1c650e7a6c2 service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f571b12-5573-459a-ad19-5f6fd9723368 req-b4d100f8-4584-4de6-bf49-b1c650e7a6c2 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f571b12-5573-459a-ad19-5f6fd9723368 req-b4d100f8-4584-4de6-bf49-b1c650e7a6c2 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f571b12-5573-459a-ad19-5f6fd9723368 req-b4d100f8-4584-4de6-bf49-b1c650e7a6c2 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:19:33 user nova-compute[76049]: WARNING nova.compute.manager [req-9f571b12-5573-459a-ad19-5f6fd9723368 req-b4d100f8-4584-4de6-bf49-b1c650e7a6c2 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received unexpected event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 00bc4c99-4801-474c-85ad-13534fe75469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 791aeb30-373c-405b-b408-fdba0d4a3cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 692c3208-4d15-4aa6-beca-87a1d2a01e40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:19:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:19:34 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:19:34 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:19:34 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:19:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.349s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:19:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76049) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 11:19:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-384c0ed2-0bc9-4d97-9d31-e333df9b5072 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.082s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:42 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 is timed out.
Nov 15 11:19:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Successfully detached device vdc from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the live domain config.
Nov 15 11:19:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOLDJcnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:19:42 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd123b3-dc90-4b85-9bb9-0fd0eb36be75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:19:42 user nova-compute[76049]: No targets found.
Nov 15 11:19:42 user nova-compute[76049]: iSNS:
Nov 15 11:19:42 user nova-compute[76049]: No targets found.
Nov 15 11:19:42 user nova-compute[76049]: STATIC:
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:19:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:19:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:19:42 user nova-compute[76049]: FIRMWARE:
Nov 15 11:19:42 user nova-compute[76049]: No targets found.
Nov 15 11:19:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:19:42 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:19:42 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c6ca85-e278-4dbf-a132-2bcd6e998aea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc58a3d-fd44-43a7-b24b-ec999923c6cf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:19:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607ae950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4'): ({'sdj'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Removing single pathed devices sdj {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32c255-2930-4e1e-b4a5-096d47c60f30]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a5f4b-60b7-42fc-99f6-21e3e7691ed8]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Flushing IO for device /dev/sdj {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[83357618-866e-49e9-8a20-b00c1a24efce]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a32fe2-f7e0-425f-9e3e-7ec309da3354]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] SCSI volumes sdj have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a717b45-f9f3-45af-afac-a71e0e020d76]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd835b6c-db79-44e8-b13d-2682aa965756]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260]
Nov 15 11:19:42 user nova-compute[76049]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4, portal: 172.16.0.220,3260] successful.
Nov 15 11:19:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7c758cf-ea8a-46cd-a760-19efa04365d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[53566947-9edf-49a8-bf63-45e20725def7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] <== disconnect_volume: return (322ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:19:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:43 user nova-compute[76049]: DEBUG nova.objects.instance [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'flavor' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:19:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-33bf97c2-ebea-4b43-84b5-9b59cafd14d8 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.674s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:19:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-changed-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Refreshing instance network info cache due to event network-changed-a55c1b89-518e-4352-95c1-a69902fcda3c. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] Acquiring lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] Acquired lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Refreshing network info cache for port a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updated VIF entry in instance network info cache for port a55c1b89-518e-4352-95c1-a69902fcda3c. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updating instance_info_cache with network_info: [{"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:19:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d10bb639-ece9-4bef-b0c9-b5654879363a req-3409dcf6-60dd-4711-bede-a5c389052691 service nova] Releasing lock "refresh_cache-791aeb30-373c-405b-b408-fdba0d4a3cee" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:00 user nova-compute[76049]: INFO nova.compute.manager [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Terminating instance
Nov 15 11:20:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-changed-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing instance network info cache due to event network-changed-53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] Acquiring lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] Acquired lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Refreshing network info cache for port 53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-1afec515-b475-4259-b30a-0f5aa76e95a6 req-ce7313bc-8e2b-4927-b9d5-3ee26239a6de service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-unplugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1afec515-b475-4259-b30a-0f5aa76e95a6 req-ce7313bc-8e2b-4927-b9d5-3ee26239a6de service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1afec515-b475-4259-b30a-0f5aa76e95a6 req-ce7313bc-8e2b-4927-b9d5-3ee26239a6de service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1afec515-b475-4259-b30a-0f5aa76e95a6 req-ce7313bc-8e2b-4927-b9d5-3ee26239a6de service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-1afec515-b475-4259-b30a-0f5aa76e95a6 req-ce7313bc-8e2b-4927-b9d5-3ee26239a6de service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-unplugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-1afec515-b475-4259-b30a-0f5aa76e95a6 req-ce7313bc-8e2b-4927-b9d5-3ee26239a6de service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-unplugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Instance destroyed successfully.
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lazy-loading 'resources' on Instance uuid 692c3208-4d15-4aa6-beca-87a1d2a01e40 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:01 user nova-compute[76049]: INFO nova.compute.manager [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Unrescuing
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.network.neutron [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-408780271',display_name='tempest-TestShelveInstance-server-408780271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-408780271',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYCuXNCW/4pVjnhoKADFMrGImq6QQkGiaZ7uvbMBH77mDZowtoehfvC+we1wSh6a66bnUekMn5ts30TyXU+UiDc1BPZm5qH6ffvw8z9cxtBpzcRLa6D3oeFs0U4ypkfxQ==',key_name='tempest-TestShelveInstance-236142358',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6517681dc6ca4788a7ae3e969a9831cc',ramdisk_id='',reservation_id='r-2kbv4mks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289836315',owner_user_name='tempest-TestShelveInstance-289836315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:25Z,user_data=None,user_id='842ce026504c47a993bbda489c8385a4',uuid=692c3208-4d15-4aa6-beca-87a1d2a01e40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converting VIF {"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_vif [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53fecff6-a0, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9eddb26-9fd6-4c6b-8fa5-f2b28d144efc) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:01 user nova-compute[76049]: INFO os_vif [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b6:b6,bridge_name='br-int',has_traffic_filtering=True,id=53fecff6-a026-446e-95ff-97b67e493503,network=Network(1666ae88-6be1-4716-bb5e-064f68668f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fecff6-a0')
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XweUJdoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:01 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updated VIF entry in instance network info cache for port 53fecff6-a026-446e-95ff-97b67e493503. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [{"id": "53fecff6-a026-446e-95ff-97b67e493503", "address": "fa:16:3e:a9:b6:b6", "network": {"id": "1666ae88-6be1-4716-bb5e-064f68668f91", "bridge": "br-int", "label": "tempest-TestShelveInstance-1491852229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6517681dc6ca4788a7ae3e969a9831cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fecff6-a0", "ovs_interfaceid": "53fecff6-a026-446e-95ff-97b67e493503", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-41a762bb-cfa0-4caa-b571-afd7b6c74004 req-8448fbcd-c6da-41a6-a4ea-faa2da8f8dbc service nova] Releasing lock "refresh_cache-692c3208-4d15-4aa6-beca-87a1d2a01e40" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd86395-c2a2-45ef-9680-0a93a7fcc1c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:20:01 user nova-compute[76049]: No targets found.
Nov 15 11:20:01 user nova-compute[76049]: iSNS:
Nov 15 11:20:01 user nova-compute[76049]: No targets found.
Nov 15 11:20:01 user nova-compute[76049]: STATIC:
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:20:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:01 user nova-compute[76049]: FIRMWARE:
Nov 15 11:20:01 user nova-compute[76049]: No targets found.
Nov 15 11:20:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:20:01 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:20:01 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b138d9-21df-41a8-809d-925d0dacd9a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e5d566-7990-46ec-a930-d69fae2a4dcc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284613c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3'): ({'sdf'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Removing single pathed devices sdf {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e901287c-493e-4665-b4c3-72f9018bad67]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1868c6dc-bf44-4c18-a108-1f3bab55129e]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Flushing IO for device /dev/sdf {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b7138-4ffd-49f9-91da-a6a2fcb00cea]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:20:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b12058a-18b3-4fc7-a149-92542661e7d7]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_122d4fff', '/dev/disk/by-id/scsi-1SCST_BIO122d4fff-c3c449555169d53b', '/dev/disk/by-id/scsi-26333633434393535') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce971f-0981-4762-b347-82c9c6eec41d]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd71ac-e05c-429c-98e7-4ec37747b817]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddda097-e41f-4683-bb25-3d1eebab4136]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260]
Nov 15 11:20:02 user nova-compute[76049]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e25910-8dea-43b7-8b04-bb6b6420ecd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ca44c-285f-471b-b2b6-1587f45e4c12]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] <== disconnect_volume: return (365ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:20:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Deleting instance files /opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40_del
Nov 15 11:20:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Deletion of /opt/stack/data/nova/instances/692c3208-4d15-4aa6-beca-87a1d2a01e40_del complete
Nov 15 11:20:02 user nova-compute[76049]: INFO nova.compute.manager [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'flavor' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-d03fa5c9-e618-4bf9-8b4e-af13bf73a868 req-323b7f14-6476-4596-a3ef-9403f642644c service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d03fa5c9-e618-4bf9-8b4e-af13bf73a868 req-323b7f14-6476-4596-a3ef-9403f642644c service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d03fa5c9-e618-4bf9-8b4e-af13bf73a868 req-323b7f14-6476-4596-a3ef-9403f642644c service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d03fa5c9-e618-4bf9-8b4e-af13bf73a868 req-323b7f14-6476-4596-a3ef-9403f642644c service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-d03fa5c9-e618-4bf9-8b4e-af13bf73a868 req-323b7f14-6476-4596-a3ef-9403f642644c service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:02 user nova-compute[76049]: WARNING nova.compute.manager [req-d03fa5c9-e618-4bf9-8b4e-af13bf73a868 req-323b7f14-6476-4596-a3ef-9403f642644c service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:20:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance destroyed successfully.
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:03 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Took 0.92 seconds to deallocate network for instance.
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Acquiring lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] No waiting events found dispatching network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:03 user nova-compute[76049]: WARNING nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received unexpected event network-vif-plugged-53fecff6-a026-446e-95ff-97b67e493503 for instance with vm_state active and task_state deleting.
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Received event network-vif-deleted-53fecff6-a026-446e-95ff-97b67e493503 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing instance network info cache due to event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:03 user nova-compute[76049]: INFO nova.compute.manager [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 11:20:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] [instance: 692c3208-4d15-4aa6-beca-87a1d2a01e40] Deleting volume: 13e25910-8dea-43b7-8b04-bb6b6420ecd3 {{(pid=76049) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.network.neutron [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updated VIF entry in instance network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.network.neutron [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing instance network info cache due to event network-changed-5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Acquiring lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Acquired lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.network.neutron [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Refreshing network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:04 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Deleted allocations for instance 692c3208-4d15-4aa6-beca-87a1d2a01e40
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.network.neutron [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updated VIF entry in instance network info cache for port 5a1e963d-d9f8-4923-8b9e-19a1027bba51. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.network.neutron [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [{"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-166ef7a6-8730-4983-930d-a5142c08aa49 req-2b8ef8c1-658b-4bd1-9f53-677bff431335 service nova] Releasing lock "refresh_cache-00bc4c99-4801-474c-85ad-13534fe75469" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ef3f351b-e056-47e4-91f5-632b28d77a60 tempest-TestShelveInstance-289836315 tempest-TestShelveInstance-289836315-project-member] Lock "692c3208-4d15-4aa6-beca-87a1d2a01e40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.766s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:04 user nova-compute[76049]: WARNING nova.compute.manager [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:04 user nova-compute[76049]: WARNING nova.compute.manager [req-ef63c5f1-b3c5-4cb0-bec4-7fc78585e441 req-7a1fcab8-a7bc-4fb4-9850-731ce6b820da service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:20:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "c1efb824-016b-4903-8acd-5cef97ba4ee2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:20:06 user nova-compute[76049]: INFO nova.compute.claims [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Claim successful on node user
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-aaaf3db4-3481-4085-8b92-2e2956caf123 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:20:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:06 user nova-compute[76049]: WARNING nova.compute.manager [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state active and task_state None.
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-changed-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Refreshing instance network info cache due to event network-changed-f2928970-70be-4f69-bbb4-7dd28dd12a00. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] Acquiring lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] Acquired lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.network.neutron [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Refreshing network info cache for port f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:06 user nova-compute[76049]: INFO nova.virt.block_device [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Booting with volume snapshot 8e95b4b7-7885-47dc-afee-2a50bdb9a55e at /dev/vda
Nov 15 11:20:06 user nova-compute[76049]: DEBUG nova.policy [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac7d77f50629413bb7b6c9457156af67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0917737287484e2498e2dcf616b8679e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:20:07 user nova-compute[76049]: DEBUG nova.network.neutron [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Updated VIF entry in instance network info cache for port f2928970-70be-4f69-bbb4-7dd28dd12a00. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:07 user nova-compute[76049]: DEBUG nova.network.neutron [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Updating instance_info_cache with network_info: [{"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-05e48c8a-4921-4889-82a6-937ff93c078f req-03b6c464-ed17-41a8-9af2-795f723fe6b8 service nova] Releasing lock "refresh_cache-64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:07 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Successfully created port: 5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:20:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Successfully updated port: 5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquired lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-changed-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Refreshing instance network info cache due to event network-changed-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] Acquiring lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Updating instance_info_cache with network_info: [{"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Releasing lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Instance network_info: |[{"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] Acquired lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:08 user nova-compute[76049]: DEBUG nova.network.neutron [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Refreshing network info cache for port 5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:09 user nova-compute[76049]: DEBUG nova.network.neutron [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Updated VIF entry in instance network info cache for port 5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:09 user nova-compute[76049]: DEBUG nova.network.neutron [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Updating instance_info_cache with network_info: [{"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c02353aa-48a5-4684-855d-8c9e3d5ae2d7 req-822e9297-aa07-4f9d-a868-7b315c50413f service nova] Releasing lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:10 user nova-compute[76049]: INFO nova.compute.manager [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Attaching volume b4c58aa4-0b09-4601-96a8-d07607335257 to /dev/vdb
Nov 15 11:20:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9eba2d-0865-447c-8a24-94e524b097bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4451105-9ca8-4fc7-ac57-9911f17b3594]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[26633176-a234-450d-a050-3bdfb7b525a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[67693562-57ba-43ea-85e0-4f273d188fb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:10 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:20:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20a59de-2ef6-4e02-b573-aa6db6f21e74]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG os_brick.utils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:10 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Updating existing volume attachment record: df3109b8-1633-4e0d-a82b-6cfeff95503b {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:20:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:12 user nova-compute[76049]: INFO nova.compute.manager [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Detaching volume 33bee106-deee-4005-971c-86b40962e3b5
Nov 15 11:20:12 user nova-compute[76049]: INFO nova.virt.block_device [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Attempting to driver detach volume 33bee106-deee-4005-971c-86b40962e3b5 from mountpoint /dev/vdb
Nov 15 11:20:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Attempting to detach device vdb from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:12 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:12 user nova-compute[76049]:   <source dev="/dev/sdh"/>
Nov 15 11:20:12 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:12 user nova-compute[76049]:   <serial>33bee106-deee-4005-971c-86b40962e3b5</serial>
Nov 15 11:20:12 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:20:12 user nova-compute[76049]: </disk>
Nov 15 11:20:12 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Successfully detached device vdb from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the persistent domain config.
Nov 15 11:20:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:12 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:12 user nova-compute[76049]:   <source dev="/dev/sdh"/>
Nov 15 11:20:12 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:12 user nova-compute[76049]:   <serial>33bee106-deee-4005-971c-86b40962e3b5</serial>
Nov 15 11:20:12 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:20:12 user nova-compute[76049]: </disk>
Nov 15 11:20:12 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG os_brick.utils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[536627a1-5031-4e12-a230-c888874b5f99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cb5008-bf1d-4978-af75-57b6c19a9c46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[396add81-d127-49e0-bdaf-564fedb54e7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[08679f37-5204-4a43-a757-f429331d4df0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:12 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:20:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3429d41e-35fd-48ec-ab8c-80df1e0370c7]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG os_brick.utils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Updating existing volume attachment record: d47bf782-aa3c-48a7-b45f-ce265d7ca739 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:20:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkhpRiUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:16 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27db45-d598-4ad6-a851-767af4191d40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:20:16 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1711a519-a4f6-44a8-afa6-d0939d542bcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257] added
Nov 15 11:20:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[21489fa7-8747-44f9-b902-4fe071f635af]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e67c050-cfae-4f80-8af9-ceba8c85faa8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkhpRiUn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkhpRiUn" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e890b409-0f3c-4797-81ef-c4aad3c4c0cb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wkhpRiUn'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aaf3f9-f3f3-4a0f-83db-0cfc636268ba]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c435d290-3b41-4875-a603-e2738252ae64]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[454965ea-7d6c-41aa-93db-c5940e2b51f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260]
Nov 15 11:20:16 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7328f01e-5e1e-476c-b2bd-cdb975fc3235]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e82f34-8096-42a2-aa56-5472c0d016bc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lazy-loading 'flavor' on Instance uuid 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d85ee58-792d-433a-8605-84faaf03af97]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkhpRiUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:16 user nova-compute[76049]: INFO nova.compute.manager [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Attaching volume a4acd1da-cc65-4716-825f-f4b4ed278581 to /dev/vdb
Nov 15 11:20:16 user nova-compute[76049]: DEBUG os_brick.utils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64dc9a-d75a-4be3-9446-f7c26f7cbe78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e9fa2-a078-49c9-b91c-b8404a8ab97d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[391443ca-968e-44fe-a42d-5050dc98b988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb83259-342a-4638-9c01-804b1773da22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:17 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:20:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded1b3a5-218c-42b4-899f-3df9701fd080]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG os_brick.utils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating existing volume attachment record: ed4e0d47-14de-4b20-ab07-49f80e7cd0da {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23164623635373139', 'path': '/dev/sdf'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164623635373139', 'path': '/dev/sdf'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:20:17 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:17 user nova-compute[76049]:   <source dev="/dev/sdf"/>
Nov 15 11:20:17 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:17 user nova-compute[76049]:   <serial>b4c58aa4-0b09-4601-96a8-d07607335257</serial>
Nov 15 11:20:17 user nova-compute[76049]: </disk>
Nov 15 11:20:17 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:20:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:20:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Creating image(s)
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Ensure instance console log exists: /opt/stack/data/nova/instances/c1efb824-016b-4903-8acd-5cef97ba4ee2/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Start _get_guest_xml network_info=[{"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T11:20:01Z,direct_url=<?>,disk_format='qcow2',id=a3579eb3-2fce-4ec4-9b11-39819feec701,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-767948680',owner='0917737287484e2498e2dcf616b8679e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T11:20:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrPwRkiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1efb824-016b-4903-8acd-5cef97ba4ee2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f102fc8d-576a-4c14-b697-1338966f761c', 'serial': 'f102fc8d-576a-4c14-b697-1338966f761c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'd47bf782-aa3c-48a7-b45f-ce265d7ca739', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:20:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T11:20:01Z,direct_url=<?>,disk_format='qcow2',id=a3579eb3-2fce-4ec4-9b11-39819feec701,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-767948680',owner='0917737287484e2498e2dcf616b8679e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T11:20:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrPwRkiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:18 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:18 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:18 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No VIF found with MAC fa:16:3e:3e:9b:cd, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d18af-837d-468b-ae91-75c5b1ca6b54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:20:18 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[774d4422-f04e-454e-83f5-e5e878023379]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c] added
Nov 15 11:20:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fb48e7-4d69-4a79-8711-a0a54551d003]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bbc78a-d616-4e85-a58a-63059786ef9f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrPwRkiB {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrPwRkiB" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[62294ca5-7e1e-4c24-aef7-f07d5c9ded20]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LrPwRkiB'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a468eb-3ba6-4905-8597-74e21b1ae990 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.644s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3d9af9-e66b-4941-94e1-5baed3876157]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b2bd0-30ee-4cb3-8ceb-596f2f4b21f5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5ac039-ae1c-449f-8fae-23b44c21fd5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260]
Nov 15 11:20:18 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae723a5d-102c-49b3-aa09-6b2bf00fedc0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14812d-d4e5-464c-8b4f-98b5e4a88ce1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:18 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:18 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] HCTL ('41', '-', '-', 0) found on session 39 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8cc5e-1e9a-4222-8735-e1ef0cb65997]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching for a device in session 39 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:20:18 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrPwRkiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23239326439663939', 'path': '/dev/sdj'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239326439663939', 'path': '/dev/sdj'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1366753006',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1366753006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1366753006',id=33,image_ref='a3579eb3-2fce-4ec4-9b11-39819feec701',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFxB8o3FCmk4HmLyZzxWqOF6wOrooQO9DnKrkSrz/RYq0dovwLpxribR+myqVHKvCFQb76NrUyxRDtUWanTYSzDppzQSVkRNNXY6LPHUwUZDFbM6r1yKxy2syDUSjgnvQ==',key_name='tempest-keypair-1784257651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-nizdtnpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2118546811',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac7d77f50629413bb7b6c9457156af67',uuid=c1efb824-016b-4903-8acd-5cef97ba4ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc0524-fe') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'pci_devices' on Instance uuid c1efb824-016b-4903-8acd-5cef97ba4ee2 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:20:19 user nova-compute[76049]:   <uuid>c1efb824-016b-4903-8acd-5cef97ba4ee2</uuid>
Nov 15 11:20:19 user nova-compute[76049]:   <name>instance-00000021</name>
Nov 15 11:20:19 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:20:19 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:20:19 user nova-compute[76049]:   <metadata>
Nov 15 11:20:19 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:20:19 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:20:19 user nova-compute[76049]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1366753006</nova:name>
Nov 15 11:20:19 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:20:18</nova:creationTime>
Nov 15 11:20:19 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:20:19 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:20:19 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:20:19 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:20:19 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:20:19 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:20:19 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:20:19 user nova-compute[76049]:       <nova:owner>
Nov 15 11:20:19 user nova-compute[76049]:         <nova:user uuid="ac7d77f50629413bb7b6c9457156af67">tempest-TestVolumeBootPattern-2118546811-project-member</nova:user>
Nov 15 11:20:19 user nova-compute[76049]:         <nova:project uuid="0917737287484e2498e2dcf616b8679e">tempest-TestVolumeBootPattern-2118546811</nova:project>
Nov 15 11:20:19 user nova-compute[76049]:       </nova:owner>
Nov 15 11:20:19 user nova-compute[76049]:       <nova:root type="image" uuid="a3579eb3-2fce-4ec4-9b11-39819feec701"/>
Nov 15 11:20:19 user nova-compute[76049]:       <nova:ports>
Nov 15 11:20:19 user nova-compute[76049]:         <nova:port uuid="5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49">
Nov 15 11:20:19 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 11:20:19 user nova-compute[76049]:         </nova:port>
Nov 15 11:20:19 user nova-compute[76049]:       </nova:ports>
Nov 15 11:20:19 user nova-compute[76049]:     </nova:instance>
Nov 15 11:20:19 user nova-compute[76049]:   </metadata>
Nov 15 11:20:19 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:20:19 user nova-compute[76049]:     <system>
Nov 15 11:20:19 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:20:19 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:20:19 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:20:19 user nova-compute[76049]:       <entry name="serial">c1efb824-016b-4903-8acd-5cef97ba4ee2</entry>
Nov 15 11:20:19 user nova-compute[76049]:       <entry name="uuid">c1efb824-016b-4903-8acd-5cef97ba4ee2</entry>
Nov 15 11:20:19 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:20:19 user nova-compute[76049]:     </system>
Nov 15 11:20:19 user nova-compute[76049]:   </sysinfo>
Nov 15 11:20:19 user nova-compute[76049]:   <os>
Nov 15 11:20:19 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:20:19 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:20:19 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:20:19 user nova-compute[76049]:   </os>
Nov 15 11:20:19 user nova-compute[76049]:   <features>
Nov 15 11:20:19 user nova-compute[76049]:     <acpi/>
Nov 15 11:20:19 user nova-compute[76049]:     <apic/>
Nov 15 11:20:19 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:20:19 user nova-compute[76049]:   </features>
Nov 15 11:20:19 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:20:19 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:20:19 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:20:19 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:20:19 user nova-compute[76049]:   </clock>
Nov 15 11:20:19 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:20:19 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:20:19 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:20:19 user nova-compute[76049]:   </cpu>
Nov 15 11:20:19 user nova-compute[76049]:   <devices>
Nov 15 11:20:19 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:20:19 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:19 user nova-compute[76049]:       <source dev="/dev/sdj"/>
Nov 15 11:20:19 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:20:19 user nova-compute[76049]:       <serial>f102fc8d-576a-4c14-b697-1338966f761c</serial>
Nov 15 11:20:19 user nova-compute[76049]:     </disk>
Nov 15 11:20:19 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:20:19 user nova-compute[76049]:       <mac address="fa:16:3e:e5:05:a2"/>
Nov 15 11:20:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:19 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:20:19 user nova-compute[76049]:       <target dev="tap5bfc0524-fe"/>
Nov 15 11:20:19 user nova-compute[76049]:     </interface>
Nov 15 11:20:19 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:20:19 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/c1efb824-016b-4903-8acd-5cef97ba4ee2/console.log" append="off"/>
Nov 15 11:20:19 user nova-compute[76049]:     </serial>
Nov 15 11:20:19 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:20:19 user nova-compute[76049]:     <video>
Nov 15 11:20:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:19 user nova-compute[76049]:     </video>
Nov 15 11:20:19 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:20:19 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:20:19 user nova-compute[76049]:     </rng>
Nov 15 11:20:19 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:20:19 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:20:19 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:20:19 user nova-compute[76049]:     </memballoon>
Nov 15 11:20:19 user nova-compute[76049]:   </devices>
Nov 15 11:20:19 user nova-compute[76049]: </domain>
Nov 15 11:20:19 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1366753006',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1366753006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1366753006',id=33,image_ref='a3579eb3-2fce-4ec4-9b11-39819feec701',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFxB8o3FCmk4HmLyZzxWqOF6wOrooQO9DnKrkSrz/RYq0dovwLpxribR+myqVHKvCFQb76NrUyxRDtUWanTYSzDppzQSVkRNNXY6LPHUwUZDFbM6r1yKxy2syDUSjgnvQ==',key_name='tempest-keypair-1784257651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-nizdtnpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2118546811',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac7d77f50629413bb7b6c9457156af67',uuid=c1efb824-016b-4903-8acd-5cef97ba4ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc0524-fe') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG os_vif [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc0524-fe') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5fe57be-5be3-59e9-afaf-0fdaefe020f0', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bfc0524-fe, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bfc0524-fe, col_values=(('qos', UUID('38b2e135-0881-4f0a-ad94-6ac3c286dbd6')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bfc0524-fe, col_values=(('external_ids', {'iface-id': '5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:05:a2', 'vm-uuid': 'c1efb824-016b-4903-8acd-5cef97ba4ee2'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:19 user nova-compute[76049]: INFO os_vif [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc0524-fe')
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No VIF found with MAC fa:16:3e:e5:05:a2, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:20 user nova-compute[76049]: INFO nova.compute.manager [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Detaching volume 42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:20:20 user nova-compute[76049]: INFO nova.virt.block_device [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Attempting to driver detach volume 42cd664b-e9b0-472a-8695-e0ed4c1a62e5 from mountpoint /dev/vdb
Nov 15 11:20:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Attempting to detach device vdb from instance 125d7724-a310-49e5-9117-3c6a0527b117 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:20:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:20 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:20 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:20:20 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:20 user nova-compute[76049]:   <serial>42cd664b-e9b0-472a-8695-e0ed4c1a62e5</serial>
Nov 15 11:20:20 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:20:20 user nova-compute[76049]: </disk>
Nov 15 11:20:20 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully detached device vdb from instance 125d7724-a310-49e5-9117-3c6a0527b117 from the persistent domain config.
Nov 15 11:20:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 125d7724-a310-49e5-9117-3c6a0527b117 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:20:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:20 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:20 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:20:20 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:20 user nova-compute[76049]:   <serial>42cd664b-e9b0-472a-8695-e0ed4c1a62e5</serial>
Nov 15 11:20:20 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:20:20 user nova-compute[76049]: </disk>
Nov 15 11:20:20 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bb54b5c2-6099-4ed6-9561-0fef463e76bf req-9ad55dae-2d2b-4fd7-99a9-c7cb99db3269 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb54b5c2-6099-4ed6-9561-0fef463e76bf req-9ad55dae-2d2b-4fd7-99a9-c7cb99db3269 service nova] Acquiring lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb54b5c2-6099-4ed6-9561-0fef463e76bf req-9ad55dae-2d2b-4fd7-99a9-c7cb99db3269 service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bb54b5c2-6099-4ed6-9561-0fef463e76bf req-9ad55dae-2d2b-4fd7-99a9-c7cb99db3269 service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bb54b5c2-6099-4ed6-9561-0fef463e76bf req-9ad55dae-2d2b-4fd7-99a9-c7cb99db3269 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] No waiting events found dispatching network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:21 user nova-compute[76049]: WARNING nova.compute.manager [req-bb54b5c2-6099-4ed6-9561-0fef463e76bf req-9ad55dae-2d2b-4fd7-99a9-c7cb99db3269 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received unexpected event network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 for instance with vm_state building and task_state spawning.
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6367e8f8-6189-4498-8626-1c4836957c11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6367e8f8-6189-4498-8626-1c4836957c11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:22 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:22 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:22 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[877dc747-9929-47e0-9150-34f75ee7863a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:20:22 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9ce774-5607-435b-960f-ebf4cca9ab9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581] added
Nov 15 11:20:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:20:22 user nova-compute[76049]: INFO nova.compute.claims [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Claim successful on node user
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e813c533-e2ae-4e01-8db4-5e81bba49f51]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10912f9-085b-4b11-8f64-f3d99543dcb2]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiWFmkwh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiWFmkwh" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5164f9bb-7f15-45d3-8b24-d3aa65074061]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiWFmkwh'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eb42f9-95bb-4078-a4da-a9ac2050728f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10171fd-4f30-4b17-bbab-5955b6d67aaa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae73cc40-d3ab-4821-8e58-488d53d907c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]
Nov 15 11:20:22 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b1af37-7f7a-4f6b-a459-901dfbc4880a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c472364-17d8-407f-b25b-3adc708b1920]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:22 user nova-compute[76049]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:22 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] HCTL ('42', '-', '-', 0) found on session 40 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb273f2-ae0b-4970-93df-bf65e2388da1]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching for a device in session 40 and hctl ['42', '*', '*', 0] yield: None {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:20:22 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:20:22 user nova-compute[76049]: DEBUG nova.policy [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3405f82948e641e685ecccb007c4c60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d20305cc32b4da29ebe034a326e401e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:20:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Creating image(s)
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "/opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-becabff2-ee1b-40d7-b319-7ad1f6b5fd7a req-a1a4324d-e6ff-4bf3-bb11-36adad06179f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-becabff2-ee1b-40d7-b319-7ad1f6b5fd7a req-a1a4324d-e6ff-4bf3-bb11-36adad06179f service nova] Acquiring lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-becabff2-ee1b-40d7-b319-7ad1f6b5fd7a req-a1a4324d-e6ff-4bf3-bb11-36adad06179f service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-becabff2-ee1b-40d7-b319-7ad1f6b5fd7a req-a1a4324d-e6ff-4bf3-bb11-36adad06179f service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-becabff2-ee1b-40d7-b319-7ad1f6b5fd7a req-a1a4324d-e6ff-4bf3-bb11-36adad06179f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] No waiting events found dispatching network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:23 user nova-compute[76049]: WARNING nova.compute.manager [req-becabff2-ee1b-40d7-b319-7ad1f6b5fd7a req-a1a4324d-e6ff-4bf3-bb11-36adad06179f service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received unexpected event network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 for instance with vm_state building and task_state spawning.
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Instance spawned successfully.
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk 1073741824" returned: 0 in 0.067s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Successfully created port: 577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:20:23 user nova-compute[76049]: INFO nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching for a device in session 40 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26261663362323832', 'path': '/dev/sdk'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261663362323832', 'path': '/dev/sdk'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lazy-loading 'flavor' on Instance uuid 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:20:23 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:23 user nova-compute[76049]:   <source dev="/dev/sdk"/>
Nov 15 11:20:23 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:23 user nova-compute[76049]:   <serial>a4acd1da-cc65-4716-825f-f4b4ed278581</serial>
Nov 15 11:20:23 user nova-compute[76049]: </disk>
Nov 15 11:20:23 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:20:23 user nova-compute[76049]: INFO nova.compute.manager [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Took 17.60 seconds to build instance.
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d7ec7edc-40cd-447f-b6c5-222ae8618798 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.714s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Cannot resize image /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Ensure instance console log exists: /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-changed-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Refreshing instance network info cache due to event network-changed-56fdea95-142b-46f5-9040-eb62a67c9fdc. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] Acquiring lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] Acquired lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Refreshing network info cache for port 56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No VIF found with MAC fa:16:3e:88:80:29, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Successfully updated port: 577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquired lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4a3d964-064b-4242-a2a5-1dda34eeba0c tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.398s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Updating instance_info_cache with network_info: [{"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Releasing lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Instance network_info: |[{"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Start _get_guest_xml network_info=[{"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:24 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1993752648',display_name='tempest-AttachVolumeNegativeTest-server-1993752648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1993752648',id=34,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8tw90gUAtyV0Fo18F63gVOn96AVJcFVpG9bGDuMwRL9QfxNAO0he4vmGeKWJBQoNO5o9qoq9vWamstIBNU9YlwPtpVauL9IxJeK8E1SmMy16r0+mFU+hEJ4gHSqyTGww==',key_name='tempest-keypair-1698852172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-nfg3zo19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=6367e8f8-6189-4498-8626-1c4836957c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f9:7e,bridge_name='br-int',has_traffic_filtering=True,id=577ca24b-c6f0-4330-a336-5c31c162cb8e,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577ca24b-c6') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'pci_devices' on Instance uuid 6367e8f8-6189-4498-8626-1c4836957c11 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:20:24 user nova-compute[76049]:   <uuid>6367e8f8-6189-4498-8626-1c4836957c11</uuid>
Nov 15 11:20:24 user nova-compute[76049]:   <name>instance-00000022</name>
Nov 15 11:20:24 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:20:24 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:20:24 user nova-compute[76049]:   <metadata>
Nov 15 11:20:24 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:20:24 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:20:24 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1993752648</nova:name>
Nov 15 11:20:24 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:20:24</nova:creationTime>
Nov 15 11:20:24 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:20:24 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:20:24 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:20:24 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:20:24 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:20:24 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:20:24 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:20:24 user nova-compute[76049]:       <nova:owner>
Nov 15 11:20:24 user nova-compute[76049]:         <nova:user uuid="3405f82948e641e685ecccb007c4c60d">tempest-AttachVolumeNegativeTest-2136408759-project-member</nova:user>
Nov 15 11:20:24 user nova-compute[76049]:         <nova:project uuid="2d20305cc32b4da29ebe034a326e401e">tempest-AttachVolumeNegativeTest-2136408759</nova:project>
Nov 15 11:20:24 user nova-compute[76049]:       </nova:owner>
Nov 15 11:20:24 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:20:24 user nova-compute[76049]:       <nova:ports>
Nov 15 11:20:24 user nova-compute[76049]:         <nova:port uuid="577ca24b-c6f0-4330-a336-5c31c162cb8e">
Nov 15 11:20:24 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 11:20:24 user nova-compute[76049]:         </nova:port>
Nov 15 11:20:24 user nova-compute[76049]:       </nova:ports>
Nov 15 11:20:24 user nova-compute[76049]:     </nova:instance>
Nov 15 11:20:24 user nova-compute[76049]:   </metadata>
Nov 15 11:20:24 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:20:24 user nova-compute[76049]:     <system>
Nov 15 11:20:24 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:20:24 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:20:24 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:20:24 user nova-compute[76049]:       <entry name="serial">6367e8f8-6189-4498-8626-1c4836957c11</entry>
Nov 15 11:20:24 user nova-compute[76049]:       <entry name="uuid">6367e8f8-6189-4498-8626-1c4836957c11</entry>
Nov 15 11:20:24 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:20:24 user nova-compute[76049]:     </system>
Nov 15 11:20:24 user nova-compute[76049]:   </sysinfo>
Nov 15 11:20:24 user nova-compute[76049]:   <os>
Nov 15 11:20:24 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:20:24 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:20:24 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:20:24 user nova-compute[76049]:   </os>
Nov 15 11:20:24 user nova-compute[76049]:   <features>
Nov 15 11:20:24 user nova-compute[76049]:     <acpi/>
Nov 15 11:20:24 user nova-compute[76049]:     <apic/>
Nov 15 11:20:24 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:20:24 user nova-compute[76049]:   </features>
Nov 15 11:20:24 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:20:24 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:20:24 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:20:24 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:20:24 user nova-compute[76049]:   </clock>
Nov 15 11:20:24 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:20:24 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:20:24 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:20:24 user nova-compute[76049]:   </cpu>
Nov 15 11:20:24 user nova-compute[76049]:   <devices>
Nov 15 11:20:24 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:20:24 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:20:24 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk"/>
Nov 15 11:20:24 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:20:24 user nova-compute[76049]:     </disk>
Nov 15 11:20:24 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:20:24 user nova-compute[76049]:       <mac address="fa:16:3e:40:f9:7e"/>
Nov 15 11:20:24 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:24 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:20:24 user nova-compute[76049]:       <target dev="tap577ca24b-c6"/>
Nov 15 11:20:24 user nova-compute[76049]:     </interface>
Nov 15 11:20:24 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:20:24 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/console.log" append="off"/>
Nov 15 11:20:24 user nova-compute[76049]:     </serial>
Nov 15 11:20:24 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:20:24 user nova-compute[76049]:     <video>
Nov 15 11:20:24 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:24 user nova-compute[76049]:     </video>
Nov 15 11:20:24 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:20:24 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:20:24 user nova-compute[76049]:     </rng>
Nov 15 11:20:24 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:20:24 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:20:24 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:20:24 user nova-compute[76049]:     </memballoon>
Nov 15 11:20:24 user nova-compute[76049]:   </devices>
Nov 15 11:20:24 user nova-compute[76049]: </domain>
Nov 15 11:20:24 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1993752648',display_name='tempest-AttachVolumeNegativeTest-server-1993752648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1993752648',id=34,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8tw90gUAtyV0Fo18F63gVOn96AVJcFVpG9bGDuMwRL9QfxNAO0he4vmGeKWJBQoNO5o9qoq9vWamstIBNU9YlwPtpVauL9IxJeK8E1SmMy16r0+mFU+hEJ4gHSqyTGww==',key_name='tempest-keypair-1698852172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-nfg3zo19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=6367e8f8-6189-4498-8626-1c4836957c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f9:7e,bridge_name='br-int',has_traffic_filtering=True,id=577ca24b-c6f0-4330-a336-5c31c162cb8e,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577ca24b-c6') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG os_vif [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f9:7e,bridge_name='br-int',has_traffic_filtering=True,id=577ca24b-c6f0-4330-a336-5c31c162cb8e,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577ca24b-c6') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b732e1-7bc6-526d-bcaa-a3eea16eaa26', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap577ca24b-c6, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap577ca24b-c6, col_values=(('qos', UUID('f7323237-917f-4895-87e1-2036e4a53a28')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap577ca24b-c6, col_values=(('external_ids', {'iface-id': '577ca24b-c6f0-4330-a336-5c31c162cb8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:f9:7e', 'vm-uuid': '6367e8f8-6189-4498-8626-1c4836957c11'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:24 user nova-compute[76049]: INFO os_vif [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f9:7e,bridge_name='br-int',has_traffic_filtering=True,id=577ca24b-c6f0-4330-a336-5c31c162cb8e,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577ca24b-c6')
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No VIF found with MAC fa:16:3e:40:f9:7e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updated VIF entry in instance network info cache for port 56fdea95-142b-46f5-9040-eb62a67c9fdc. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating instance_info_cache with network_info: [{"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-199c9c09-9f26-4ab4-bc16-7c0cd312057b req-1dfcc1fd-95cd-40b4-943d-5fab3ebecf0a service nova] Releasing lock "refresh_cache-4640743d-7ecc-4dd8-b892-1135a3add8a1" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-changed-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Refreshing instance network info cache due to event network-changed-577ca24b-c6f0-4330-a336-5c31c162cb8e. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] Acquiring lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] Acquired lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Refreshing network info cache for port 577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Updated VIF entry in instance network info cache for port 577ca24b-c6f0-4330-a336-5c31c162cb8e. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Updating instance_info_cache with network_info: [{"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e1b83b64-a9b9-4005-9da8-70254e59f427 req-ca2fb8cd-d9cf-4c5b-9b04-fa9c95fbc311 service nova] Releasing lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Stashing vm_state: active {{(pid=76049) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:20:26 user nova-compute[76049]: INFO nova.compute.claims [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Claim successful on node user
Nov 15 11:20:26 user nova-compute[76049]: INFO nova.compute.resource_tracker [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating resource usage from migration 0c2417cc-e54d-4564-acc2-fc0811890574
Nov 15 11:20:26 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:20:26 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.784s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:27 user nova-compute[76049]: INFO nova.compute.manager [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Migrating
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquired lock "compute-rpcapi-router" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:27 user nova-compute[76049]: INFO nova.compute.rpcapi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Releasing lock "compute-rpcapi-router" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquired lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:27 user nova-compute[76049]: INFO nova.compute.manager [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attaching volume 26a51102-e60a-4adc-b7f3-cb64050826c9 to /dev/vdb
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG os_brick.utils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] Acquiring lock "6367e8f8-6189-4498-8626-1c4836957c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] No waiting events found dispatching network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:27 user nova-compute[76049]: WARNING nova.compute.manager [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received unexpected event network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e for instance with vm_state building and task_state spawning.
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] Acquiring lock "6367e8f8-6189-4498-8626-1c4836957c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] No waiting events found dispatching network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:27 user nova-compute[76049]: WARNING nova.compute.manager [req-b63f28d4-72ef-4168-859a-534a6cbd521b req-e36cd3e4-0f39-48a7-9a3a-b52c7d1da685 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received unexpected event network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e for instance with vm_state building and task_state spawning.
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f61fc1-13f7-4979-9f80-418a3d5f4d05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8d8f2-b223-4318-a156-beaf59b85cf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb1661-951e-4419-81c5-16e76630b60d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6f904-2df3-41c8-9251-bac5aa56fad6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:27 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb452ed6-9dc4-420d-a104-35f05be4ed56]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG os_brick.utils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating existing volume attachment record: a1b32e6e-cb5c-4da6-a741-1765037e9f43 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Releasing lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Starting migrate_disk_and_power_off {{(pid=76049) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-c78d71f6-b839-402d-8590-e33d40cf9078 req-fa3cfe79-322a-4817-b935-c9b090f00acf service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c78d71f6-b839-402d-8590-e33d40cf9078 req-fa3cfe79-322a-4817-b935-c9b090f00acf service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c78d71f6-b839-402d-8590-e33d40cf9078 req-fa3cfe79-322a-4817-b935-c9b090f00acf service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c78d71f6-b839-402d-8590-e33d40cf9078 req-fa3cfe79-322a-4817-b935-c9b090f00acf service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-c78d71f6-b839-402d-8590-e33d40cf9078 req-fa3cfe79-322a-4817-b935-c9b090f00acf service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:28 user nova-compute[76049]: WARNING nova.compute.manager [req-c78d71f6-b839-402d-8590-e33d40cf9078 req-fa3cfe79-322a-4817-b935-c9b090f00acf service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state active and task_state resize_migrating.
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:20:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Instance spawned successfully.
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:20:29 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance destroyed successfully.
Nov 15 11:20:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1906386754-network", "vif_mac": "fa:16:3e:88:80:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1906386754-network", "vif_mac": "fa:16:3e:88:80:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_vif [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0495d054-d8, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=daca95f5-7c14-4968-9380-00f8a9b4d5d7) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:29 user nova-compute[76049]: INFO os_vif [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8')
Nov 15 11:20:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:29 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: INFO nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 15 11:20:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bdeef1-094c-4de5-b27f-85a2440cd902]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:20:29 user nova-compute[76049]: No targets found.
Nov 15 11:20:29 user nova-compute[76049]: iSNS:
Nov 15 11:20:29 user nova-compute[76049]: No targets found.
Nov 15 11:20:29 user nova-compute[76049]: STATIC:
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:20:29 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:29 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:29 user nova-compute[76049]: FIRMWARE:
Nov 15 11:20:29 user nova-compute[76049]: No targets found.
Nov 15 11:20:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:20:29 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:20:29 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0f75b-9b23-4cd2-a351-c76ce74ec4ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b286d669-a671-4f4d-9b64-beaab8c20d9b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:29 user nova-compute[76049]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62847d7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581'): ({'sdk'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Removing single pathed devices sdk {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5535a4ed-7eaf-4996-bb44-b4da814aaa4e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: INFO nova.compute.manager [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Took 7.07 seconds to build instance.
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20bad18-e214-4ad5-bbc9-55b7aaf4bf74]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flushing IO for device /dev/sdk {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9e942f26-cd35-48ea-9a1d-f586508ee2cf tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6367e8f8-6189-4498-8626-1c4836957c11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.169s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dac874-d63a-4900-9237-f1425df704f4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.049s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9608814f-5739-4ac4-8795-c6395b773d4a]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] SCSI volumes sdk have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b5bca-52cc-4ffb-b463-3c27140eff23]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c154c9-7282-496c-977d-53b62e4b4cf7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]
Nov 15 11:20:29 user nova-compute[76049]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea53b30-f54d-4724-88e9-03c4cf406ce0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== disconnect_volume: return (467ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013_resize/disk /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "cp -r /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013_resize/disk /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk" returned: 0 in 0.546s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013_resize/disk.info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk.info {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "cp -r /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013_resize/disk.info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk.info" returned: 0 in 0.039s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-b1cd6916-b9c8-432c-a45c-3c6a05a08549 req-f813ff04-f03f-469a-90b9-b7e06dddf756 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b1cd6916-b9c8-432c-a45c-3c6a05a08549 req-f813ff04-f03f-469a-90b9-b7e06dddf756 service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b1cd6916-b9c8-432c-a45c-3c6a05a08549 req-f813ff04-f03f-469a-90b9-b7e06dddf756 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b1cd6916-b9c8-432c-a45c-3c6a05a08549 req-f813ff04-f03f-469a-90b9-b7e06dddf756 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-b1cd6916-b9c8-432c-a45c-3c6a05a08549 req-f813ff04-f03f-469a-90b9-b7e06dddf756 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:30 user nova-compute[76049]: WARNING nova.compute.manager [req-b1cd6916-b9c8-432c-a45c-3c6a05a08549 req-f813ff04-f03f-469a-90b9-b7e06dddf756 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state active and task_state resize_migrating.
Nov 15 11:20:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Port 0495d054-d8d9-4a64-8306-3ae999cdb253 binding to destination host user is already ACTIVE {{(pid=76049) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquired lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Releasing lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.utils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 is timed out.
Nov 15 11:20:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Successfully detached device vdb from instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 from the live domain config.
Nov 15 11:20:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZsTxbdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:32 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d37003-07ce-43f0-8dd0-4cacedfe133e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5a6f66-ed5b-4546-b516-04ba4f347653]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:20:32 user nova-compute[76049]: No targets found.
Nov 15 11:20:32 user nova-compute[76049]: iSNS:
Nov 15 11:20:32 user nova-compute[76049]: No targets found.
Nov 15 11:20:32 user nova-compute[76049]: STATIC:
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:20:32 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:32 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:32 user nova-compute[76049]: FIRMWARE:
Nov 15 11:20:32 user nova-compute[76049]: No targets found.
Nov 15 11:20:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:20:32 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:20:32 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d528369a-b7e9-453e-81b3-93cb3f0c48f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e84145-9bab-45c5-b832-62a224e231dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac9ffa8-3c29-421e-9591-d67f64633af1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6294d9cb-94dc-4e38-8e55-c9b53b1586a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d6a8f-cbf3-4a1f-a25c-a336d8666be2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:32 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842b9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5'): ({'sdh'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Removing single pathed devices sdh {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:20:32 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb339fbc-c03b-4635-9190-01b4b546a00e]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.utils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3091c84a-5408-4eb6-b84a-aedd1e4557d3]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ca4b77-85d9-4c77-8737-9f53d026ebdd]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Flushing IO for device /dev/sdh {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0548662c-f2ef-4726-947a-afc883b8be4b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.062s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b2d4a-2337-4065-8b67-b4e031930c01]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] SCSI volumes sdh have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:20:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ac212-75ab-47ee-b8b2-2ea53a0e686f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c5723a-2db4-49d1-a631-3c774801841a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260]
Nov 15 11:20:33 user nova-compute[76049]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bee106-deee-4005-971c-86b40962e3b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f089493-c12e-49ec-b8a3-74796a89bd34]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] <== disconnect_volume: return (466ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgezcSYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:33 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:33 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:33 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db87491-21b2-4065-a073-51b8bf102431]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:20:33 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e915b3-5561-4dd6-ade6-619b6bb612b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9] added
Nov 15 11:20:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1d91e-18d6-45cf-91f6-07cfd3d05a20]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3813ee79-c595-4b1f-9018-863ba1587d2a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgezcSYV {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgezcSYV" returned: 0 in 0.084s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb42b4-256e-420e-aa26-ec7d67227ab6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgezcSYV'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab1feb-a658-4e47-9408-6f6f56ea2a0a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[86629c8c-eef9-4a25-b5fa-9a90947ca555]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:33 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:33 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd47446-7686-46b4-9ee4-fe46919e3b85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260]
Nov 15 11:20:34 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[617cc49d-6cbb-4710-9943-f9d978ae6ce4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486c9b4-3363-4356-bcf9-94c77293e02d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:34 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.507s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[271bc5db-c685-4a6d-b088-6f3e71e5164c]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgezcSYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.552s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== connect_volume: return (1559ms) {'type': 'block', 'scsi_wwn': '23563323366383763', 'path': '/dev/sdh'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563323366383763', 'path': '/dev/sdh'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:20:35 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:35 user nova-compute[76049]:   <source dev="/dev/sdh"/>
Nov 15 11:20:35 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:35 user nova-compute[76049]:   <serial>26a51102-e60a-4adc-b7f3-cb64050826c9</serial>
Nov 15 11:20:35 user nova-compute[76049]: </disk>
Nov 15 11:20:35 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:35 user nova-compute[76049]: INFO nova.compute.manager [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Detaching volume e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:20:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:35 user nova-compute[76049]: INFO nova.virt.block_device [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Attempting to driver detach volume e4871c5e-e6f8-409a-8f28-eca543a518eb from mountpoint /dev/vdb
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Attempting to detach device vdb from instance 00bc4c99-4801-474c-85ad-13534fe75469 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:35 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:35 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:20:35 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:35 user nova-compute[76049]:   <serial>e4871c5e-e6f8-409a-8f28-eca543a518eb</serial>
Nov 15 11:20:35 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:20:35 user nova-compute[76049]: </disk>
Nov 15 11:20:35 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Successfully detached device vdb from instance 00bc4c99-4801-474c-85ad-13534fe75469 from the persistent domain config.
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00bc4c99-4801-474c-85ad-13534fe75469 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:35 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:35 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:20:35 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:35 user nova-compute[76049]:   <serial>e4871c5e-e6f8-409a-8f28-eca543a518eb</serial>
Nov 15 11:20:35 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:20:35 user nova-compute[76049]: </disk>
Nov 15 11:20:35 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:20:36 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:36 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7038MB free_disk=24.938533782958984GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:36 user nova-compute[76049]: INFO nova.compute.manager [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Unshelving
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No VIF found with MAC fa:16:3e:d8:c1:d4, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Applying migration context for instance 6625217c-b0a0-48c1-972c-f460acd20013 as it has an incoming, in-progress migration 0c2417cc-e54d-4564-acc2-fc0811890574. Migration status is post-migrating {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 11:20:36 user nova-compute[76049]: INFO nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating resource usage from migration 0c2417cc-e54d-4564-acc2-fc0811890574
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 00bc4c99-4801-474c-85ad-13534fe75469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 791aeb30-373c-405b-b408-fdba0d4a3cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c1efb824-016b-4903-8acd-5cef97ba4ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6367e8f8-6189-4498-8626-1c4836957c11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Migration 0c2417cc-e54d-4564-acc2-fc0811890574 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a29980c6-88f5-446d-bd3f-7705394610c7 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.096s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.566s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'pci_requests' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:36 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'numa_topology' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:20:37 user nova-compute[76049]: INFO nova.compute.claims [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Claim successful on node user
Nov 15 11:20:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing instance network info cache due to event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] Acquiring lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] Acquired lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG nova.network.neutron [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:37 user nova-compute[76049]: INFO nova.network.neutron [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating port 3681d118-3073-4666-bcc9-39f1b4b7694f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 11:20:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG nova.network.neutron [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updated VIF entry in instance network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG nova.network.neutron [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8ba6cf32-993e-412c-b1af-9838b5e62d3b req-8d507a55-9e02-4ef9-b5cd-bb35276de63c service nova] Releasing lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquired lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG nova.compute.manager [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing instance network info cache due to event network-changed-3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] Acquiring lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'flavor' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e3fb536d-a0a2-43ee-a14e-0773b12042d9 tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.043s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG nova.network.neutron [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Releasing lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:20:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Creating image(s)
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] Acquired lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG nova.network.neutron [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Refreshing network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG nova.objects.base [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "abcf3ae688a671b92f48ecdfe4e025262fb47cd4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "abcf3ae688a671b92f48ecdfe4e025262fb47cd4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:39 user nova-compute[76049]: INFO nova.compute.manager [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Detaching volume 1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:20:39 user nova-compute[76049]: INFO nova.virt.block_device [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Attempting to driver detach volume 1799b425-ccd4-4dc9-a183-022c4b3eb855 from mountpoint /dev/vdb
Nov 15 11:20:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Attempting to detach device vdb from instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:40 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:40 user nova-compute[76049]:   <source dev="/dev/sdg"/>
Nov 15 11:20:40 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:40 user nova-compute[76049]:   <serial>1799b425-ccd4-4dc9-a183-022c4b3eb855</serial>
Nov 15 11:20:40 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:20:40 user nova-compute[76049]: </disk>
Nov 15 11:20:40 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:40 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully detached device vdb from instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 from the persistent domain config.
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:40 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:40 user nova-compute[76049]:   <source dev="/dev/sdg"/>
Nov 15 11:20:40 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:40 user nova-compute[76049]:   <serial>1799b425-ccd4-4dc9-a183-022c4b3eb855</serial>
Nov 15 11:20:40 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:20:40 user nova-compute[76049]: </disk>
Nov 15 11:20:40 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.part --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.images [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] e1072e98-00d9-4d4c-b317-54a984764ae8 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.part /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Starting finish_migration {{(pid=76049) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:20:40 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Creating image(s)
Nov 15 11:20:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updated VIF entry in instance network info cache for port 3681d118-3073-4666-bcc9-39f1b4b7694f. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing instance network info cache due to event network-changed-36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] Acquiring lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] Acquired lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Refreshing network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4392b252-59cc-4767-a5c3-184e3f05858a req-638a79d2-bdbb-45a5-b806-4222753e9571 service nova] Releasing lock "refresh_cache-644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.339s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk. size=21474836480 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 125d7724-a310-49e5-9117-3c6a0527b117 is timed out.
Nov 15 11:20:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully detached device vdb from instance 125d7724-a310-49e5-9117-3c6a0527b117 from the live domain config.
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.part /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.converted" returned: 0 in 0.949s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.416s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk 21474836480 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYSJGMXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:41 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk 21474836480" returned: 0 in 0.083s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a7cf34-cee1-40a0-a7d4-bb0d55b3dbd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:20:41 user nova-compute[76049]: No targets found.
Nov 15 11:20:41 user nova-compute[76049]: iSNS:
Nov 15 11:20:41 user nova-compute[76049]: No targets found.
Nov 15 11:20:41 user nova-compute[76049]: STATIC:
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:20:41 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:41 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:41 user nova-compute[76049]: FIRMWARE:
Nov 15 11:20:41 user nova-compute[76049]: No targets found.
Nov 15 11:20:41 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:20:41 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:20:41 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Ensure instance console log exists: /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Start _get_guest_xml network_info=[{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1906386754-network", "vif_mac": "fa:16:3e:88:80:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6625217c-b0a0-48c1-972c-f460acd20013', 'attached_at': '2023-11-15T11:20:40.000000', 'detached_at': '', 'volume_id': 'a4acd1da-cc65-4716-825f-f4b4ed278581', 'serial': 'a4acd1da-cc65-4716-825f-f4b4ed278581'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '174544fe-2546-4c69-9cc0-858d3db7f865', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5188a5-482e-4459-a74f-cadd17d6c086]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:41 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updated VIF entry in instance network info cache for port 36eca79d-0ee1-4fce-86a4-ac47c7c0d896. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [{"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "abcf3ae688a671b92f48ecdfe4e025262fb47cd4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.358s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[51175a5a-6894-4ee5-a597-c452cca65c4f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d27163f-987b-4983-aa90-f2bfb1b54de2 req-6048bd90-eb1a-44dd-8f61-4f30bcb20f70 service nova] Releasing lock "refresh_cache-dc73e2e8-49f8-4c24-a03d-26619b2b5385" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:41 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:41 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62847c7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:41 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe87a5-b7cc-44fa-b22a-3096c7cc0512]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[524f748f-c93a-4b41-861e-e428ed412a3a]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5905ea-7ba3-4860-a727-393e4285bfe5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[810680a4-6e5e-43ff-917a-e0f32a7c4a74]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4 --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "abcf3ae688a671b92f48ecdfe4e025262fb47cd4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "abcf3ae688a671b92f48ecdfe4e025262fb47cd4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[999fbb29-e039-4550-94e3-b828d46e0afb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3c6095-11bc-435c-8d77-47939c9a946b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260]
Nov 15 11:20:42 user nova-compute[76049]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42cd664b-e9b0-472a-8695-e0ed4c1a62e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[96633c0b-4c1b-4aa1-b750-9b7b51160824]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== disconnect_volume: return (438ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.264s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:42 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:42 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4 --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4,backing_fmt=raw /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7147831f-44d1-457a-9f39-85914725eb29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:20:42 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4,backing_fmt=raw /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk 1073741824" returned: 0 in 0.056s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "abcf3ae688a671b92f48ecdfe4e025262fb47cd4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f09d46-d40b-42ff-b9f9-ec415b06e741]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581] added
Nov 15 11:20:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb9717b-fac0-4c7e-846e-2b74614b6db9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ba7e7a-1b8d-4485-95f4-fdb77e4e22a4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiWFmkwh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiWFmkwh" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b642bec2-a26f-4558-842b-f1019196c759]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiWFmkwh'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca3956c-5a71-47ea-ada1-2ffea103522c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3272c-bac6-4657-8799-bb528fa9e2c3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4 --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'migration_context' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG nova.objects.base [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:20:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Rebasing disk image.
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[263bb813-6b7a-4903-84ea-dbd7e2d9dcb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]
Nov 15 11:20:42 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4bb46f-2b32-4e7f-bede-67953e83ec30]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d77a12-21fc-4d4b-9693-ad9108691dd7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f607873-2e7f-45af-810f-b73477417443]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc -F raw /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f5fd2042-519e-46e1-9913-70a398747689 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.438s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== connect_volume: return (1730ms) {'type': 'block', 'scsi_wwn': '26261663362323832', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261663362323832', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3821036f-27f9-4bcd-9dc0-6a1f8035ff54 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3821036f-27f9-4bcd-9dc0-6a1f8035ff54 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3821036f-27f9-4bcd-9dc0-6a1f8035ff54 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3821036f-27f9-4bcd-9dc0-6a1f8035ff54 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76049) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3821036f-27f9-4bcd-9dc0-6a1f8035ff54 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1906386754-network", "vif_mac": "fa:16:3e:88:80:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1906386754-network", "vif_mac": "fa:16:3e:88:80:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:20:43 user nova-compute[76049]:   <uuid>6625217c-b0a0-48c1-972c-f460acd20013</uuid>
Nov 15 11:20:43 user nova-compute[76049]:   <name>instance-0000001a</name>
Nov 15 11:20:43 user nova-compute[76049]:   <memory>2097152</memory>
Nov 15 11:20:43 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:20:43 user nova-compute[76049]:   <metadata>
Nov 15 11:20:43 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:20:43 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:20:43 user nova-compute[76049]:       <nova:name>tempest-ServerActionsTestOtherB-server-1158016788</nova:name>
Nov 15 11:20:43 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:20:41</nova:creationTime>
Nov 15 11:20:43 user nova-compute[76049]:       <nova:flavor name="m1.small">
Nov 15 11:20:43 user nova-compute[76049]:         <nova:memory>2048</nova:memory>
Nov 15 11:20:43 user nova-compute[76049]:         <nova:disk>20</nova:disk>
Nov 15 11:20:43 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:20:43 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:20:43 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:20:43 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:20:43 user nova-compute[76049]:       <nova:owner>
Nov 15 11:20:43 user nova-compute[76049]:         <nova:user uuid="dfc6846a39a4455798a857842912c534">tempest-ServerActionsTestOtherB-1283239424-project-member</nova:user>
Nov 15 11:20:43 user nova-compute[76049]:         <nova:project uuid="8953f0ed0ac04badb593529ffb2c567c">tempest-ServerActionsTestOtherB-1283239424</nova:project>
Nov 15 11:20:43 user nova-compute[76049]:       </nova:owner>
Nov 15 11:20:43 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:20:43 user nova-compute[76049]:       <nova:ports>
Nov 15 11:20:43 user nova-compute[76049]:         <nova:port uuid="0495d054-d8d9-4a64-8306-3ae999cdb253">
Nov 15 11:20:43 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 11:20:43 user nova-compute[76049]:         </nova:port>
Nov 15 11:20:43 user nova-compute[76049]:       </nova:ports>
Nov 15 11:20:43 user nova-compute[76049]:     </nova:instance>
Nov 15 11:20:43 user nova-compute[76049]:   </metadata>
Nov 15 11:20:43 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:20:43 user nova-compute[76049]:     <system>
Nov 15 11:20:43 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:20:43 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:20:43 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:20:43 user nova-compute[76049]:       <entry name="serial">6625217c-b0a0-48c1-972c-f460acd20013</entry>
Nov 15 11:20:43 user nova-compute[76049]:       <entry name="uuid">6625217c-b0a0-48c1-972c-f460acd20013</entry>
Nov 15 11:20:43 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:20:43 user nova-compute[76049]:     </system>
Nov 15 11:20:43 user nova-compute[76049]:   </sysinfo>
Nov 15 11:20:43 user nova-compute[76049]:   <os>
Nov 15 11:20:43 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:20:43 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:20:43 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:20:43 user nova-compute[76049]:   </os>
Nov 15 11:20:43 user nova-compute[76049]:   <features>
Nov 15 11:20:43 user nova-compute[76049]:     <acpi/>
Nov 15 11:20:43 user nova-compute[76049]:     <apic/>
Nov 15 11:20:43 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:20:43 user nova-compute[76049]:   </features>
Nov 15 11:20:43 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:20:43 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:20:43 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:20:43 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:20:43 user nova-compute[76049]:   </clock>
Nov 15 11:20:43 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:20:43 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:20:43 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:20:43 user nova-compute[76049]:   </cpu>
Nov 15 11:20:43 user nova-compute[76049]:   <devices>
Nov 15 11:20:43 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:20:43 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:20:43 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk"/>
Nov 15 11:20:43 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:20:43 user nova-compute[76049]:     </disk>
Nov 15 11:20:43 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:20:43 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:43 user nova-compute[76049]:       <source dev="/dev/sdb"/>
Nov 15 11:20:43 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:20:43 user nova-compute[76049]:       <serial>a4acd1da-cc65-4716-825f-f4b4ed278581</serial>
Nov 15 11:20:43 user nova-compute[76049]:     </disk>
Nov 15 11:20:43 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:20:43 user nova-compute[76049]:       <mac address="fa:16:3e:88:80:29"/>
Nov 15 11:20:43 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:43 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:20:43 user nova-compute[76049]:       <target dev="tap0495d054-d8"/>
Nov 15 11:20:43 user nova-compute[76049]:     </interface>
Nov 15 11:20:43 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:20:43 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/console.log" append="off"/>
Nov 15 11:20:43 user nova-compute[76049]:     </serial>
Nov 15 11:20:43 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:20:43 user nova-compute[76049]:     <video>
Nov 15 11:20:43 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:43 user nova-compute[76049]:     </video>
Nov 15 11:20:43 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:20:43 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:20:43 user nova-compute[76049]:     </rng>
Nov 15 11:20:43 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:20:43 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:20:43 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:20:43 user nova-compute[76049]:     </memballoon>
Nov 15 11:20:43 user nova-compute[76049]:   </devices>
Nov 15 11:20:43 user nova-compute[76049]: </domain>
Nov 15 11:20:43 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1906386754-network", "vif_mac": "fa:16:3e:88:80:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1906386754-network", "vif_mac": "fa:16:3e:88:80:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG os_vif [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16e507b6-9089-50c9-81d7-056d3db5bf92', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0495d054-d8, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0495d054-d8, col_values=(('qos', UUID('7263511f-6b8f-48a9-adaf-d0f652d3ca4f')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0495d054-d8, col_values=(('external_ids', {'iface-id': '0495d054-d8d9-4a64-8306-3ae999cdb253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:80:29', 'vm-uuid': '6625217c-b0a0-48c1-972c-f460acd20013'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:43 user nova-compute[76049]: INFO os_vif [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8')
Nov 15 11:20:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] No VIF found with MAC fa:16:3e:88:80:29, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-516931f9-e61f-4988-9632-598274fa56de req-bff59840-ec37-4371-a900-1021c6669cf7 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-516931f9-e61f-4988-9632-598274fa56de req-bff59840-ec37-4371-a900-1021c6669cf7 service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-516931f9-e61f-4988-9632-598274fa56de req-bff59840-ec37-4371-a900-1021c6669cf7 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-516931f9-e61f-4988-9632-598274fa56de req-bff59840-ec37-4371-a900-1021c6669cf7 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-516931f9-e61f-4988-9632-598274fa56de req-bff59840-ec37-4371-a900-1021c6669cf7 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:44 user nova-compute[76049]: WARNING nova.compute.manager [req-516931f9-e61f-4988-9632-598274fa56de req-bff59840-ec37-4371-a900-1021c6669cf7 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state active and task_state powering-off.
Nov 15 11:20:45 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance destroyed successfully.
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3821036f-27f9-4bcd-9dc0-6a1f8035ff54 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc -F raw /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk" returned: 0 in 2.559s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Ensure instance console log exists: /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Start _get_guest_xml network_info=[{"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='94b1c638810adc5bff9f03cc78915713',container_format='bare',created_at=2023-11-15T11:18:42Z,direct_url=<?>,disk_format='qcow2',id=e1072e98-00d9-4d4c-b317-54a984764ae8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-331075314-shelved',owner='4977c566adae433e8780d44d86f18757',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T11:18:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:20:45 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:45 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='94b1c638810adc5bff9f03cc78915713',container_format='bare',created_at=2023-11-15T11:18:42Z,direct_url=<?>,disk_format='qcow2',id=e1072e98-00d9-4d4c-b317-54a984764ae8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-331075314-shelved',owner='4977c566adae433e8780d44d86f18757',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T11:18:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3821036f-27f9-4bcd-9dc0-6a1f8035ff54 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.345s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.objects.base [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331075314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331075314',id=27,image_ref='e1072e98-00d9-4d4c-b317-54a984764ae8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1390670603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-a30rqbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member',shelved_at='2023-11-15T11:18:47.299257',shelved_host='user',shelved_image_id='e1072e98-00d9-4d4c-b317-54a984764ae8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'pci_devices' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.objects.base [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Object Instance<644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:20:45 user nova-compute[76049]:   <uuid>644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc</uuid>
Nov 15 11:20:45 user nova-compute[76049]:   <name>instance-0000001b</name>
Nov 15 11:20:45 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:20:45 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:20:45 user nova-compute[76049]:   <metadata>
Nov 15 11:20:45 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:20:45 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:20:45 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-331075314</nova:name>
Nov 15 11:20:45 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:20:45</nova:creationTime>
Nov 15 11:20:45 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:20:45 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:20:45 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:20:45 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:20:45 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:20:45 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:20:45 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:20:45 user nova-compute[76049]:       <nova:owner>
Nov 15 11:20:45 user nova-compute[76049]:         <nova:user uuid="fd3cb19baf044c1ca816581576c5c243">tempest-AttachVolumeShelveTestJSON-10410443-project-member</nova:user>
Nov 15 11:20:45 user nova-compute[76049]:         <nova:project uuid="4977c566adae433e8780d44d86f18757">tempest-AttachVolumeShelveTestJSON-10410443</nova:project>
Nov 15 11:20:45 user nova-compute[76049]:       </nova:owner>
Nov 15 11:20:45 user nova-compute[76049]:       <nova:root type="image" uuid="e1072e98-00d9-4d4c-b317-54a984764ae8"/>
Nov 15 11:20:45 user nova-compute[76049]:       <nova:ports>
Nov 15 11:20:45 user nova-compute[76049]:         <nova:port uuid="3681d118-3073-4666-bcc9-39f1b4b7694f">
Nov 15 11:20:45 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:20:45 user nova-compute[76049]:         </nova:port>
Nov 15 11:20:45 user nova-compute[76049]:       </nova:ports>
Nov 15 11:20:45 user nova-compute[76049]:     </nova:instance>
Nov 15 11:20:45 user nova-compute[76049]:   </metadata>
Nov 15 11:20:45 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:20:45 user nova-compute[76049]:     <system>
Nov 15 11:20:45 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:20:45 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:20:45 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:20:45 user nova-compute[76049]:       <entry name="serial">644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc</entry>
Nov 15 11:20:45 user nova-compute[76049]:       <entry name="uuid">644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc</entry>
Nov 15 11:20:45 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:20:45 user nova-compute[76049]:     </system>
Nov 15 11:20:45 user nova-compute[76049]:   </sysinfo>
Nov 15 11:20:45 user nova-compute[76049]:   <os>
Nov 15 11:20:45 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:20:45 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:20:45 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:20:45 user nova-compute[76049]:   </os>
Nov 15 11:20:45 user nova-compute[76049]:   <features>
Nov 15 11:20:45 user nova-compute[76049]:     <acpi/>
Nov 15 11:20:45 user nova-compute[76049]:     <apic/>
Nov 15 11:20:45 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:20:45 user nova-compute[76049]:   </features>
Nov 15 11:20:45 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:20:45 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:20:45 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:20:45 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:20:45 user nova-compute[76049]:   </clock>
Nov 15 11:20:45 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:20:45 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:20:45 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:20:45 user nova-compute[76049]:   </cpu>
Nov 15 11:20:45 user nova-compute[76049]:   <devices>
Nov 15 11:20:45 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:20:45 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:20:45 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk"/>
Nov 15 11:20:45 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:20:45 user nova-compute[76049]:     </disk>
Nov 15 11:20:45 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:20:45 user nova-compute[76049]:       <mac address="fa:16:3e:af:4e:e7"/>
Nov 15 11:20:45 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:45 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:20:45 user nova-compute[76049]:       <target dev="tap3681d118-30"/>
Nov 15 11:20:45 user nova-compute[76049]:     </interface>
Nov 15 11:20:45 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:20:45 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/console.log" append="off"/>
Nov 15 11:20:45 user nova-compute[76049]:     </serial>
Nov 15 11:20:45 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:20:45 user nova-compute[76049]:     <video>
Nov 15 11:20:45 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:45 user nova-compute[76049]:     </video>
Nov 15 11:20:45 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:20:45 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:20:45 user nova-compute[76049]:     </rng>
Nov 15 11:20:45 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:20:45 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:20:45 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:20:45 user nova-compute[76049]:     </memballoon>
Nov 15 11:20:45 user nova-compute[76049]:   </devices>
Nov 15 11:20:45 user nova-compute[76049]: </domain>
Nov 15 11:20:45 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331075314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331075314',id=27,image_ref='e1072e98-00d9-4d4c-b317-54a984764ae8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1390670603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-a30rqbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member',shelved_at='2023-11-15T11:18:47.299257',shelved_host='user',shelved_image_id='e1072e98-00d9-4d4c-b317-54a984764ae8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG os_vif [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d9ed03b-d125-5e08-8d8c-4a7340ad0551', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3681d118-30, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3681d118-30, col_values=(('qos', UUID('c6073f57-7193-41e6-95a4-5610103ffc76')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3681d118-30, col_values=(('external_ids', {'iface-id': '3681d118-3073-4666-bcc9-39f1b4b7694f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:4e:e7', 'vm-uuid': '644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:45 user nova-compute[76049]: INFO os_vif [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30')
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] No VIF found with MAC fa:16:3e:af:4e:e7, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:46 user nova-compute[76049]: WARNING nova.compute.manager [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state stopped and task_state None.
Nov 15 11:20:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:46 user nova-compute[76049]: WARNING nova.compute.manager [req-14674184-a25b-4630-91af-ba2fab86a887 req-62413ad4-3b9c-4bd6-b5f9-811e62f9a460 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state active and task_state resize_finish.
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-c3f39924-01f7-453d-927a-643f2e1ca740 req-f1578bf8-89c5-43f1-8915-bc64b0b4bc2d service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c3f39924-01f7-453d-927a-643f2e1ca740 req-f1578bf8-89c5-43f1-8915-bc64b0b4bc2d service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c3f39924-01f7-453d-927a-643f2e1ca740 req-f1578bf8-89c5-43f1-8915-bc64b0b4bc2d service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c3f39924-01f7-453d-927a-643f2e1ca740 req-f1578bf8-89c5-43f1-8915-bc64b0b4bc2d service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-c3f39924-01f7-453d-927a-643f2e1ca740 req-f1578bf8-89c5-43f1-8915-bc64b0b4bc2d service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:47 user nova-compute[76049]: WARNING nova.compute.manager [req-c3f39924-01f7-453d-927a-643f2e1ca740 req-f1578bf8-89c5-43f1-8915-bc64b0b4bc2d service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 11:20:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:48 user nova-compute[76049]: INFO nova.compute.manager [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Detaching volume 26a51102-e60a-4adc-b7f3-cb64050826c9
Nov 15 11:20:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:48 user nova-compute[76049]: INFO nova.virt.block_device [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attempting to driver detach volume 26a51102-e60a-4adc-b7f3-cb64050826c9 from mountpoint /dev/vdb
Nov 15 11:20:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Attempting to detach device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:48 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:48 user nova-compute[76049]:   <source dev="/dev/sdh"/>
Nov 15 11:20:48 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:48 user nova-compute[76049]:   <serial>26a51102-e60a-4adc-b7f3-cb64050826c9</serial>
Nov 15 11:20:48 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:20:48 user nova-compute[76049]: </disk>
Nov 15 11:20:48 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config.
Nov 15 11:20:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:20:48 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:20:48 user nova-compute[76049]:   <source dev="/dev/sdh"/>
Nov 15 11:20:48 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:20:48 user nova-compute[76049]:   <serial>26a51102-e60a-4adc-b7f3-cb64050826c9</serial>
Nov 15 11:20:48 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:20:48 user nova-compute[76049]: </disk>
Nov 15 11:20:48 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-d46ef7ff-f2af-482e-a25c-a322ea94ab85 req-6dd18496-5823-4c77-acca-ed261bfb5fb6 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d46ef7ff-f2af-482e-a25c-a322ea94ab85 req-6dd18496-5823-4c77-acca-ed261bfb5fb6 service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d46ef7ff-f2af-482e-a25c-a322ea94ab85 req-6dd18496-5823-4c77-acca-ed261bfb5fb6 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d46ef7ff-f2af-482e-a25c-a322ea94ab85 req-6dd18496-5823-4c77-acca-ed261bfb5fb6 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-d46ef7ff-f2af-482e-a25c-a322ea94ab85 req-6dd18496-5823-4c77-acca-ed261bfb5fb6 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:48 user nova-compute[76049]: WARNING nova.compute.manager [req-d46ef7ff-f2af-482e-a25c-a322ea94ab85 req-6dd18496-5823-4c77-acca-ed261bfb5fb6 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state active and task_state resize_finish.
Nov 15 11:20:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:20:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-3d71326f-4af5-4f35-9f50-63529066f0f5 req-45e026f1-6540-4d26-92ce-8d6559bf94f4 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3d71326f-4af5-4f35-9f50-63529066f0f5 req-45e026f1-6540-4d26-92ce-8d6559bf94f4 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3d71326f-4af5-4f35-9f50-63529066f0f5 req-45e026f1-6540-4d26-92ce-8d6559bf94f4 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3d71326f-4af5-4f35-9f50-63529066f0f5 req-45e026f1-6540-4d26-92ce-8d6559bf94f4 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-3d71326f-4af5-4f35-9f50-63529066f0f5 req-45e026f1-6540-4d26-92ce-8d6559bf94f4 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:49 user nova-compute[76049]: WARNING nova.compute.manager [req-3d71326f-4af5-4f35-9f50-63529066f0f5 req-45e026f1-6540-4d26-92ce-8d6559bf94f4 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 11:20:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:20:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:20:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance spawned successfully.
Nov 15 11:20:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:20:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance running successfully.
Nov 15 11:20:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Failed to set time: agent not configured {{(pid=76049) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 11:20:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d4529aa5-daf9-4b57-8cb8-f626b377e59f tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] finish_migration finished successfully. {{(pid=76049) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 11:20:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:20:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71eea90a-aa47-4242-bf92-fe68307b0c7b tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.787s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "b3633502-a889-43a5-96df-ad92136e1231" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:20:55 user nova-compute[76049]: INFO nova.compute.claims [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Claim successful on node user
Nov 15 11:20:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.network.neutron [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:20:55 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:20:55 user nova-compute[76049]: DEBUG nova.policy [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bd63b00a9c4f8983e335cf898f77ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a9fe3c211d4bb78b9c6878147a9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:20:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Creating image(s)
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 00bc4c99-4801-474c-85ad-13534fe75469 is timed out.
Nov 15 11:20:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Successfully detached device vdb from instance 00bc4c99-4801-474c-85ad-13534fe75469 from the live domain config.
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPDNBvhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:20:56 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[016689cf-f105-49ae-93aa-0f597dd76221]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:20:56 user nova-compute[76049]: No targets found.
Nov 15 11:20:56 user nova-compute[76049]: iSNS:
Nov 15 11:20:56 user nova-compute[76049]: No targets found.
Nov 15 11:20:56 user nova-compute[76049]: STATIC:
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:20:56 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:20:56 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:20:56 user nova-compute[76049]: FIRMWARE:
Nov 15 11:20:56 user nova-compute[76049]: No targets found.
Nov 15 11:20:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:20:56 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:20:56 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8755b4df-be72-470e-81a8-55211475ea4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ab54a-7778-4c51-bfc1-0099772920c9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:20:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f628477c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6879c22-8a81-486b-a277-bfb71a85a6b8]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk 1073741824" returned: 0 in 0.057s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78725e-0824-41f6-bbf6-813b5c27ec91]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[681eeab9-3403-46e1-bbd4-4280063d2cd4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd274917-5852-438f-9700-be22fcb403a5]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e391e131-3d99-45bc-811f-e98355eee10f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4de211-390d-4ce6-9113-f3cc55833fb0]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260]
Nov 15 11:20:56 user nova-compute[76049]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb, portal: 172.16.0.220,3260] successful.
Nov 15 11:20:56 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4871c5e-e6f8-409a-8f28-eca543a518eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce1c74-b4f1-4cd3-8581-6d700d3b2f0d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] <== disconnect_volume: return (484ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Successfully created port: d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Cannot resize image /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Ensure instance console log exists: /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Successfully updated port: d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received event network-changed-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Refreshing instance network info cache due to event network-changed-d65e677e-4c77-4fc4-bc40-521a9e3d63ab. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] Acquiring lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'flavor' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b5c09747-221f-4bae-8860-f7c8fead2f94 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.538s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Updating instance_info_cache with network_info: [{"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Instance network_info: |[{"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] Acquired lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.neutron [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Refreshing network info cache for port d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Start _get_guest_xml network_info=[{"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:20:57 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:57 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1457574042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1457574042',id=35,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-xlc6vwt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:56Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=b3633502-a889-43a5-96df-ad92136e1231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=d65e677e-4c77-4fc4-bc40-521a9e3d63ab,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65e677e-4c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'pci_devices' on Instance uuid b3633502-a889-43a5-96df-ad92136e1231 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:20:57 user nova-compute[76049]:   <uuid>b3633502-a889-43a5-96df-ad92136e1231</uuid>
Nov 15 11:20:57 user nova-compute[76049]:   <name>instance-00000023</name>
Nov 15 11:20:57 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:20:57 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:20:57 user nova-compute[76049]:   <metadata>
Nov 15 11:20:57 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:20:57 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:20:57 user nova-compute[76049]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1457574042</nova:name>
Nov 15 11:20:57 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:20:57</nova:creationTime>
Nov 15 11:20:57 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:20:57 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:20:57 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:20:57 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:20:57 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:20:57 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:20:57 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:20:57 user nova-compute[76049]:       <nova:owner>
Nov 15 11:20:57 user nova-compute[76049]:         <nova:user uuid="81bd63b00a9c4f8983e335cf898f77ad">tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member</nova:user>
Nov 15 11:20:57 user nova-compute[76049]:         <nova:project uuid="25a9fe3c211d4bb78b9c6878147a9c75">tempest-ServerBootFromVolumeStableRescueTest-1027868851</nova:project>
Nov 15 11:20:57 user nova-compute[76049]:       </nova:owner>
Nov 15 11:20:57 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:20:57 user nova-compute[76049]:       <nova:ports>
Nov 15 11:20:57 user nova-compute[76049]:         <nova:port uuid="d65e677e-4c77-4fc4-bc40-521a9e3d63ab">
Nov 15 11:20:57 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 11:20:57 user nova-compute[76049]:         </nova:port>
Nov 15 11:20:57 user nova-compute[76049]:       </nova:ports>
Nov 15 11:20:57 user nova-compute[76049]:     </nova:instance>
Nov 15 11:20:57 user nova-compute[76049]:   </metadata>
Nov 15 11:20:57 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:20:57 user nova-compute[76049]:     <system>
Nov 15 11:20:57 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:20:57 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:20:57 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:20:57 user nova-compute[76049]:       <entry name="serial">b3633502-a889-43a5-96df-ad92136e1231</entry>
Nov 15 11:20:57 user nova-compute[76049]:       <entry name="uuid">b3633502-a889-43a5-96df-ad92136e1231</entry>
Nov 15 11:20:57 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:20:57 user nova-compute[76049]:     </system>
Nov 15 11:20:57 user nova-compute[76049]:   </sysinfo>
Nov 15 11:20:57 user nova-compute[76049]:   <os>
Nov 15 11:20:57 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:20:57 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:20:57 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:20:57 user nova-compute[76049]:   </os>
Nov 15 11:20:57 user nova-compute[76049]:   <features>
Nov 15 11:20:57 user nova-compute[76049]:     <acpi/>
Nov 15 11:20:57 user nova-compute[76049]:     <apic/>
Nov 15 11:20:57 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:20:57 user nova-compute[76049]:   </features>
Nov 15 11:20:57 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:20:57 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:20:57 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:20:57 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:20:57 user nova-compute[76049]:   </clock>
Nov 15 11:20:57 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:20:57 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:20:57 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:20:57 user nova-compute[76049]:   </cpu>
Nov 15 11:20:57 user nova-compute[76049]:   <devices>
Nov 15 11:20:57 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:20:57 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:20:57 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk"/>
Nov 15 11:20:57 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:20:57 user nova-compute[76049]:     </disk>
Nov 15 11:20:57 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:20:57 user nova-compute[76049]:       <mac address="fa:16:3e:b9:ed:8c"/>
Nov 15 11:20:57 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:57 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:20:57 user nova-compute[76049]:       <target dev="tapd65e677e-4c"/>
Nov 15 11:20:57 user nova-compute[76049]:     </interface>
Nov 15 11:20:57 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:20:57 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/console.log" append="off"/>
Nov 15 11:20:57 user nova-compute[76049]:     </serial>
Nov 15 11:20:57 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:20:57 user nova-compute[76049]:     <video>
Nov 15 11:20:57 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:20:57 user nova-compute[76049]:     </video>
Nov 15 11:20:57 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:20:57 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:20:57 user nova-compute[76049]:     </rng>
Nov 15 11:20:57 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:20:57 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:20:57 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:20:57 user nova-compute[76049]:     </memballoon>
Nov 15 11:20:57 user nova-compute[76049]:   </devices>
Nov 15 11:20:57 user nova-compute[76049]: </domain>
Nov 15 11:20:57 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1457574042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1457574042',id=35,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-xlc6vwt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:56Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=b3633502-a889-43a5-96df-ad92136e1231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=d65e677e-4c77-4fc4-bc40-521a9e3d63ab,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65e677e-4c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG os_vif [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=d65e677e-4c77-4fc4-bc40-521a9e3d63ab,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65e677e-4c') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '790fb94f-f73f-5a34-9599-5952eb94d84f', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd65e677e-4c, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd65e677e-4c, col_values=(('qos', UUID('c7c00823-88fc-4018-9acf-8af215fec6ba')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd65e677e-4c, col_values=(('external_ids', {'iface-id': 'd65e677e-4c77-4fc4-bc40-521a9e3d63ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ed:8c', 'vm-uuid': 'b3633502-a889-43a5-96df-ad92136e1231'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:20:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:57 user nova-compute[76049]: INFO os_vif [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=d65e677e-4c77-4fc4-bc40-521a9e3d63ab,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65e677e-4c')
Nov 15 11:20:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:20:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No VIF found with MAC fa:16:3e:b9:ed:8c, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:20:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:58 user nova-compute[76049]: DEBUG nova.network.neutron [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Updated VIF entry in instance network info cache for port d65e677e-4c77-4fc4-bc40-521a9e3d63ab. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:20:58 user nova-compute[76049]: DEBUG nova.network.neutron [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Updating instance_info_cache with network_info: [{"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:20:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-92821cd9-3e9d-4615-a0fc-54eb995d0baa req-1ecfc054-499d-4c86-bcf1-9f5b0bdf13cb service nova] Releasing lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-90d9bf4f-bd30-4a4b-8a11-8034ad845527 req-c409094d-4d06-47b5-a97c-618eb087ba1f service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received event network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-90d9bf4f-bd30-4a4b-8a11-8034ad845527 req-c409094d-4d06-47b5-a97c-618eb087ba1f service nova] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-90d9bf4f-bd30-4a4b-8a11-8034ad845527 req-c409094d-4d06-47b5-a97c-618eb087ba1f service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-90d9bf4f-bd30-4a4b-8a11-8034ad845527 req-c409094d-4d06-47b5-a97c-618eb087ba1f service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:20:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-90d9bf4f-bd30-4a4b-8a11-8034ad845527 req-c409094d-4d06-47b5-a97c-618eb087ba1f service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] No waiting events found dispatching network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:20:59 user nova-compute[76049]: WARNING nova.compute.manager [req-90d9bf4f-bd30-4a4b-8a11-8034ad845527 req-c409094d-4d06-47b5-a97c-618eb087ba1f service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received unexpected event network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab for instance with vm_state building and task_state spawning.
Nov 15 11:20:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:00 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 is timed out.
Nov 15 11:21:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully detached device vdb from instance dc73e2e8-49f8-4c24-a03d-26619b2b5385 from the live domain config.
Nov 15 11:21:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:21:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqbAHVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:21:00 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:21:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:21:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:21:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb3834d-2d55-4de9-b71b-4a653147218f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:21:01 user nova-compute[76049]: No targets found.
Nov 15 11:21:01 user nova-compute[76049]: iSNS:
Nov 15 11:21:01 user nova-compute[76049]: No targets found.
Nov 15 11:21:01 user nova-compute[76049]: STATIC:
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:21:01 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:01 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:01 user nova-compute[76049]: FIRMWARE:
Nov 15 11:21:01 user nova-compute[76049]: No targets found.
Nov 15 11:21:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:21:01 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:21:01 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16961c7-0c42-4e74-b842-61b7cd630845]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55573c-5fba-418f-bc0c-8fb1d51e9989]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6260723250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855'): ({'sdg'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Removing single pathed devices sdg {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc70e39a-855f-466b-9d24-f969c05fa319]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f230b2-986b-4f96-b6d8-628d987daf00]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flushing IO for device /dev/sdg {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8190ac7-f95c-4430-8b42-43dec59b3434]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[67610808-c2ce-4030-9caa-da2d440ce4cf]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c53ed60-b3b0-4d96-816b-b42203b10ece]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[223662c5-cff4-484d-91f1-46b2f907db7c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260]
Nov 15 11:21:01 user nova-compute[76049]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855, portal: 172.16.0.220,3260] successful.
Nov 15 11:21:01 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1799b425-ccd4-4dc9-a183-022c4b3eb855 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[19591846-5f15-463a-a2e0-6fd232368756]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== disconnect_volume: return (333ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-ac737525-702c-4631-a6ff-1eedf897901b req-3a15f3d1-8477-4fb2-a197-5acc06dd1924 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received event network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ac737525-702c-4631-a6ff-1eedf897901b req-3a15f3d1-8477-4fb2-a197-5acc06dd1924 service nova] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ac737525-702c-4631-a6ff-1eedf897901b req-3a15f3d1-8477-4fb2-a197-5acc06dd1924 service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ac737525-702c-4631-a6ff-1eedf897901b req-3a15f3d1-8477-4fb2-a197-5acc06dd1924 service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-ac737525-702c-4631-a6ff-1eedf897901b req-3a15f3d1-8477-4fb2-a197-5acc06dd1924 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] No waiting events found dispatching network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:01 user nova-compute[76049]: WARNING nova.compute.manager [req-ac737525-702c-4631-a6ff-1eedf897901b req-3a15f3d1-8477-4fb2-a197-5acc06dd1924 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received unexpected event network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab for instance with vm_state building and task_state spawning.
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:21:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: b3633502-a889-43a5-96df-ad92136e1231] Instance spawned successfully.
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'flavor' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:02 user nova-compute[76049]: INFO nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5c3b6642-d563-494d-88df-850b9efdda94 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.813s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:02 user nova-compute[76049]: INFO nova.compute.manager [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Took 7.11 seconds to build instance.
Nov 15 11:21:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-11eb8fd4-9427-4343-9181-5ee78fb252cc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "b3633502-a889-43a5-96df-ad92136e1231" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.206s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.013s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:02 user nova-compute[76049]: INFO nova.compute.manager [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Terminating instance
Nov 15 11:21:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Instance destroyed successfully.
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lazy-loading 'resources' on Instance uuid fe8b1a44-b45b-454f-bfdc-78dd9fea5706 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-254339762',display_name='tempest-TestServerVolumeAttachmentScenario-server-254339762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-254339762',id=28,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQd+lR3WRIGTuVmueQOcuovXMsCwypF9p/nCG8ukJ4IHTTQdvPK/2gHU5rM4CfD/KiWtRKWEUW7uYySYi/hTjm9RjsEuMRhldNkdriSdHGKwkVcslVUHpL5a+zNz45NDg==',key_name='tempest-keypair-1138407128',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8954bff85c4e23bbbd4e145b3c9f66',ramdisk_id='',reservation_id='r-35s5c2b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1692254182',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1692254182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:17:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be68e6cecbdf4b4bac53b63914451334',uuid=fe8b1a44-b45b-454f-bfdc-78dd9fea5706,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Converting VIF {"id": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "address": "fa:16:3e:e9:bb:29", "network": {"id": "d052483f-4f99-4794-af16-adcb47e6da14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1847042081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8954bff85c4e23bbbd4e145b3c9f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a61161e-50", "ovs_interfaceid": "3a61161e-500e-48da-bd40-d35b8b88a4f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:bb:29,bridge_name='br-int',has_traffic_filtering=True,id=3a61161e-500e-48da-bd40-d35b8b88a4f7,network=Network(d052483f-4f99-4794-af16-adcb47e6da14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a61161e-50') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG os_vif [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:bb:29,bridge_name='br-int',has_traffic_filtering=True,id=3a61161e-500e-48da-bd40-d35b8b88a4f7,network=Network(d052483f-4f99-4794-af16-adcb47e6da14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a61161e-50') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a61161e-50, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4164d498-990e-4318-9ad1-a00136ad82a4) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: INFO os_vif [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:bb:29,bridge_name='br-int',has_traffic_filtering=True,id=3a61161e-500e-48da-bd40-d35b8b88a4f7,network=Network(d052483f-4f99-4794-af16-adcb47e6da14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a61161e-50')
Nov 15 11:21:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Deleting instance files /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706_del
Nov 15 11:21:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Deletion of /opt/stack/data/nova/instances/fe8b1a44-b45b-454f-bfdc-78dd9fea5706_del complete
Nov 15 11:21:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:03 user nova-compute[76049]: INFO nova.compute.manager [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-unplugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-unplugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-unplugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:03 user nova-compute[76049]: WARNING nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received unexpected event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with vm_state active and task_state deleting.
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:03 user nova-compute[76049]: WARNING nova.compute.manager [req-eaa0ac60-a992-4198-8dda-976a8d783b4e req-1a345513-577d-463f-b6be-647d239275cf service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received unexpected event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with vm_state active and task_state deleting.
Nov 15 11:21:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:21:05 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Took 1.84 seconds to deallocate network for instance.
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:05 user nova-compute[76049]: WARNING nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received unexpected event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with vm_state deleted and task_state None.
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-unplugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-unplugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:05 user nova-compute[76049]: WARNING nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received unexpected event network-vif-unplugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with vm_state deleted and task_state None.
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Acquiring lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] No waiting events found dispatching network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:05 user nova-compute[76049]: WARNING nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received unexpected event network-vif-plugged-3a61161e-500e-48da-bd40-d35b8b88a4f7 for instance with vm_state deleted and task_state None.
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3b04ee5-0cd6-421b-bbff-702014654839 req-c615bc18-d2c9-477c-b61c-8695c43b8000 service nova] [instance: fe8b1a44-b45b-454f-bfdc-78dd9fea5706] Received event network-vif-deleted-3a61161e-500e-48da-bd40-d35b8b88a4f7 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:21:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:05 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Deleted allocations for instance fe8b1a44-b45b-454f-bfdc-78dd9fea5706
Nov 15 11:21:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d5acdbd9-e2b8-4128-9886-ceefdff5609d tempest-TestServerVolumeAttachmentScenario-1692254182 tempest-TestServerVolumeAttachmentScenario-1692254182-project-member] Lock "fe8b1a44-b45b-454f-bfdc-78dd9fea5706" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.542s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:08 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 is timed out.
Nov 15 11:21:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config.
Nov 15 11:21:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgezcSYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:21:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae58c06-56e8-4a84-afee-9958bfe75a2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:21:08 user nova-compute[76049]: No targets found.
Nov 15 11:21:08 user nova-compute[76049]: iSNS:
Nov 15 11:21:08 user nova-compute[76049]: No targets found.
Nov 15 11:21:08 user nova-compute[76049]: STATIC:
Nov 15 11:21:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c
Nov 15 11:21:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:21:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:21:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:21:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9
Nov 15 11:21:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:21:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:21:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:08 user nova-compute[76049]: FIRMWARE:
Nov 15 11:21:08 user nova-compute[76049]: No targets found.
Nov 15 11:21:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:21:08 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:21:08 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7accb332-a950-4c3e-8fbd-980270b1b36b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f67ab1-1080-40c0-906f-01cd70e93f75]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607ad990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9'): ({'sdh'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Removing single pathed devices sdh {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9c026-331e-4602-ae63-828a1ec52fd4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a4db1-fb15-4857-8542-f867e40b9d1e]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Flushing IO for device /dev/sdh {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[841f392e-e5da-4098-8537-1fcc91ce1f9a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85bbbc-a9fd-4099-9454-0194c25785c1]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] SCSI volumes sdh have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb53c28-749e-4043-9056-bcd20e77b37a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b734f5-9b22-45bb-b1d4-e583ba577bf7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260]
Nov 15 11:21:09 user nova-compute[76049]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9, portal: 172.16.0.220,3260] successful.
Nov 15 11:21:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a51102-e60a-4adc-b7f3-cb64050826c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b586fcc-9b5d-46b3-b5f9-c5f9108e9007]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== disconnect_volume: return (338ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG nova.objects.instance [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-62965aa1-16c6-4164-a969-f816b2ee7b10 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:25 user nova-compute[76049]: INFO nova.compute.manager [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Terminating instance
Nov 15 11:21:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-3ee4a341-ce12-40b0-89e0-e4fb55e31ad5 req-5c8a5523-15ec-4d8e-830d-bd1da83c0251 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3ee4a341-ce12-40b0-89e0-e4fb55e31ad5 req-5c8a5523-15ec-4d8e-830d-bd1da83c0251 service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3ee4a341-ce12-40b0-89e0-e4fb55e31ad5 req-5c8a5523-15ec-4d8e-830d-bd1da83c0251 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3ee4a341-ce12-40b0-89e0-e4fb55e31ad5 req-5c8a5523-15ec-4d8e-830d-bd1da83c0251 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-3ee4a341-ce12-40b0-89e0-e4fb55e31ad5 req-5c8a5523-15ec-4d8e-830d-bd1da83c0251 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-3ee4a341-ce12-40b0-89e0-e4fb55e31ad5 req-5c8a5523-15ec-4d8e-830d-bd1da83c0251 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-unplugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:21:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Instance destroyed successfully.
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.objects.instance [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lazy-loading 'resources' on Instance uuid 00bc4c99-4801-474c-85ad-13534fe75469 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1539619791',display_name='tempest-ServerStableDeviceRescueTest-server-1539619791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1539619791',id=20,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5YJ6b2hQTaoK1rprHOO7ah8cYXA9w5jrVcvFmaVX8faQX1l0vcPy31SLLQHA4MWR+Rd3TzxheoN+k2VY5atuSZjVgz+xwoPtwSMUOjzv+PcGV1X5IbQVwo3pdCvohqmQ==',key_name='tempest-keypair-62701307',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:18:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f28351c85da4988a1f942d5948be8c2',ramdisk_id='',reservation_id='r-vi4h98mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1167147547',owner_user_name='tempest-ServerStableDeviceRescueTest-1167147547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:20:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dbaf60d380d45e8844a85b0064ed9c3',uuid=00bc4c99-4801-474c-85ad-13534fe75469,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converting VIF {"id": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "address": "fa:16:3e:f4:ca:26", "network": {"id": "6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1538591804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f28351c85da4988a1f942d5948be8c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1e963d-d9", "ovs_interfaceid": "5a1e963d-d9f8-4923-8b9e-19a1027bba51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG os_vif [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a1e963d-d9, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=431d0bef-6450-47c7-b34a-de5f10aff4c4) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:26 user nova-compute[76049]: INFO os_vif [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:26,bridge_name='br-int',has_traffic_filtering=True,id=5a1e963d-d9f8-4923-8b9e-19a1027bba51,network=Network(6f6ebb23-7482-4e4c-b8d1-bdd5b98bbf4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1e963d-d9')
Nov 15 11:21:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Deleting instance files /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469_del
Nov 15 11:21:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Deletion of /opt/stack/data/nova/instances/00bc4c99-4801-474c-85ad-13534fe75469_del complete
Nov 15 11:21:26 user nova-compute[76049]: INFO nova.compute.manager [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 11:21:26 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:21:26 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:21:27 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:21:27 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Took 0.94 seconds to deallocate network for instance.
Nov 15 11:21:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-4bc23fd1-f480-488c-a0ec-ea08b1829fd8 req-b4b0bb27-00ea-4499-b7fc-c749a5a2b2e7 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4bc23fd1-f480-488c-a0ec-ea08b1829fd8 req-b4b0bb27-00ea-4499-b7fc-c749a5a2b2e7 service nova] Acquiring lock "00bc4c99-4801-474c-85ad-13534fe75469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4bc23fd1-f480-488c-a0ec-ea08b1829fd8 req-b4b0bb27-00ea-4499-b7fc-c749a5a2b2e7 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4bc23fd1-f480-488c-a0ec-ea08b1829fd8 req-b4b0bb27-00ea-4499-b7fc-c749a5a2b2e7 service nova] Lock "00bc4c99-4801-474c-85ad-13534fe75469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-4bc23fd1-f480-488c-a0ec-ea08b1829fd8 req-b4b0bb27-00ea-4499-b7fc-c749a5a2b2e7 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] No waiting events found dispatching network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:28 user nova-compute[76049]: WARNING nova.compute.manager [req-4bc23fd1-f480-488c-a0ec-ea08b1829fd8 req-b4b0bb27-00ea-4499-b7fc-c749a5a2b2e7 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received unexpected event network-vif-plugged-5a1e963d-d9f8-4923-8b9e-19a1027bba51 for instance with vm_state deleted and task_state None.
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-4bc23fd1-f480-488c-a0ec-ea08b1829fd8 req-b4b0bb27-00ea-4499-b7fc-c749a5a2b2e7 service nova] [instance: 00bc4c99-4801-474c-85ad-13534fe75469] Received event network-vif-deleted-5a1e963d-d9f8-4923-8b9e-19a1027bba51 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.655s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:28 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Deleted allocations for instance 00bc4c99-4801-474c-85ad-13534fe75469
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-baa30eec-8534-4073-b9f9-b7530388c541 tempest-ServerStableDeviceRescueTest-1167147547 tempest-ServerStableDeviceRescueTest-1167147547-project-member] Lock "00bc4c99-4801-474c-85ad-13534fe75469" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:21:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:32 user nova-compute[76049]: INFO nova.compute.manager [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Terminating instance
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-98c60f58-3cf2-44bf-b163-6446634468f7 req-23c166a6-9fb2-47b3-9a3c-4e069fb68754 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-unplugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-98c60f58-3cf2-44bf-b163-6446634468f7 req-23c166a6-9fb2-47b3-9a3c-4e069fb68754 service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-98c60f58-3cf2-44bf-b163-6446634468f7 req-23c166a6-9fb2-47b3-9a3c-4e069fb68754 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-98c60f58-3cf2-44bf-b163-6446634468f7 req-23c166a6-9fb2-47b3-9a3c-4e069fb68754 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-98c60f58-3cf2-44bf-b163-6446634468f7 req-23c166a6-9fb2-47b3-9a3c-4e069fb68754 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-unplugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-98c60f58-3cf2-44bf-b163-6446634468f7 req-23c166a6-9fb2-47b3-9a3c-4e069fb68754 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-unplugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:21:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Instance destroyed successfully.
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'resources' on Instance uuid dc73e2e8-49f8-4c24-a03d-26619b2b5385 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-448703032',display_name='tempest-TestMinimumBasicScenario-server-448703032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-448703032',id=25,image_ref='180af431-270d-4091-b0da-1c317715ef45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtW7Pv/CTEQkZolMC1Q4+U0OLBqJDH32lXVA5ecs4bYB6xk4wPqW7BGdAFzo93d9FBWksP5/B0Tougn/WUp0pe1IPRc2Hi/73yasP3KFgqBSySHCk24H19TQRgkJ/PPUw==',key_name='tempest-TestMinimumBasicScenario-622609574',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-fy00h2mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='180af431-270d-4091-b0da-1c317715ef45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:54Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=dc73e2e8-49f8-4c24-a03d-26619b2b5385,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "address": "fa:16:3e:11:f9:3e", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36eca79d-0e", "ovs_interfaceid": "36eca79d-0ee1-4fce-86a4-ac47c7c0d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG os_vif [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36eca79d-0e, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc81c589-9933-42f8-a99e-7b9d9d933c74) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:32 user nova-compute[76049]: INFO os_vif [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=36eca79d-0ee1-4fce-86a4-ac47c7c0d896,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36eca79d-0e')
Nov 15 11:21:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Deleting instance files /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385_del
Nov 15 11:21:32 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Deletion of /opt/stack/data/nova/instances/dc73e2e8-49f8-4c24-a03d-26619b2b5385_del complete
Nov 15 11:21:33 user nova-compute[76049]: INFO nova.compute.manager [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:21:33 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid 'dc73e2e8-49f8-4c24-a03d-26619b2b5385' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dc73e2e8-49f8-4c24-a03d-26619b2b5385' (instance-00000019)
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:21:33 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Took 0.51 seconds to deallocate network for instance.
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:21:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.770s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:34 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Deleted allocations for instance dc73e2e8-49f8-4c24-a03d-26619b2b5385
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0344f02-1221-48c6-b47f-4a3ce64e1256 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.367s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5e3e774-5701-4e75-9751-20546ef60a72 req-ff3f5de9-5d2b-45f1-a68c-816d4e084f85 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5e3e774-5701-4e75-9751-20546ef60a72 req-ff3f5de9-5d2b-45f1-a68c-816d4e084f85 service nova] Acquiring lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5e3e774-5701-4e75-9751-20546ef60a72 req-ff3f5de9-5d2b-45f1-a68c-816d4e084f85 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5e3e774-5701-4e75-9751-20546ef60a72 req-ff3f5de9-5d2b-45f1-a68c-816d4e084f85 service nova] Lock "dc73e2e8-49f8-4c24-a03d-26619b2b5385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5e3e774-5701-4e75-9751-20546ef60a72 req-ff3f5de9-5d2b-45f1-a68c-816d4e084f85 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] No waiting events found dispatching network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:34 user nova-compute[76049]: WARNING nova.compute.manager [req-b5e3e774-5701-4e75-9751-20546ef60a72 req-ff3f5de9-5d2b-45f1-a68c-816d4e084f85 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received unexpected event network-vif-plugged-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 for instance with vm_state deleted and task_state None.
Nov 15 11:21:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5e3e774-5701-4e75-9751-20546ef60a72 req-ff3f5de9-5d2b-45f1-a68c-816d4e084f85 service nova] [instance: dc73e2e8-49f8-4c24-a03d-26619b2b5385] Received event network-vif-deleted-36eca79d-0ee1-4fce-86a4-ac47c7c0d896 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:21:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json" returned: 0 in 0.358s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:21:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:37 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:21:37 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=6974MB free_disk=24.996814727783203GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Applying migration context for instance 6625217c-b0a0-48c1-972c-f460acd20013 as it has an incoming, in-progress migration 0c2417cc-e54d-4564-acc2-fc0811890574. Migration status is finished {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 11:21:37 user nova-compute[76049]: INFO nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating resource usage from migration 0c2417cc-e54d-4564-acc2-fc0811890574
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 791aeb30-373c-405b-b408-fdba0d4a3cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c1efb824-016b-4903-8acd-5cef97ba4ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6367e8f8-6189-4498-8626-1c4836957c11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Migration 0c2417cc-e54d-4564-acc2-fc0811890574 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:38 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:21:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:21:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:21:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG nova.objects.instance [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:40 user nova-compute[76049]: INFO nova.compute.manager [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attaching volume 74ed4f7d-6fcc-434c-a93a-44a78c313ad5 to /dev/vdb
Nov 15 11:21:40 user nova-compute[76049]: DEBUG os_brick.utils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8034b76c-3e67-4f91-abde-823ac2fe39bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6740ba-0755-4863-b134-f6cb53149c12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd207b2e-be28-4d16-969e-b66f7a664231]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5039be2c-26a5-4900-9264-545eb2ad992f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:21:40 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:21:40 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40f952-bf6e-4938-acae-e16c84ba81b4]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG os_brick.utils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:21:40 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating existing volume attachment record: a8b5f401-1123-4590-9631-910551f5b03a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:21:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQgKPnkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:21:45 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:21:45 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:21:45 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef85ee-7165-4066-a88d-1477adffadc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:21:45 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b4559b-25ee-48c0-a725-01b4bedd7b42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5] added
Nov 15 11:21:45 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ea2eaa-4895-445f-9eae-4d0b08f22ea0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe2aa0-0afd-44e1-98b2-0e44cd7442a7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQgKPnkH {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQgKPnkH" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06fed89-4498-4798-92e0-739a5c1d785b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQgKPnkH'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce2ca37-8229-48a8-af3f-4b95df0f8b9e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e9ca78-ad85-4d10-afd8-3cc92a40ebd4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f636a2-11d0-4524-90db-3d880cbc61b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260]
Nov 15 11:21:45 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260] successful.
Nov 15 11:21:45 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b3f4d1-312d-4f2a-a281-32594b347d53]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c57299-31c9-4ee8-b699-8643432db4fe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)
Nov 15 11:21:45 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb707e5-39be-4e41-9f1b-d19d6e941802]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:21:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQgKPnkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:21:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:21:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26366323632656230', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:21:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366323632656230', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:21:46 user nova-compute[76049]: DEBUG nova.objects.instance [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:46 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:21:46 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:21:46 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:21:46 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:21:46 user nova-compute[76049]:   <serial>74ed4f7d-6fcc-434c-a93a-44a78c313ad5</serial>
Nov 15 11:21:46 user nova-compute[76049]: </disk>
Nov 15 11:21:46 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:21:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:21:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:21:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No VIF found with MAC fa:16:3e:d8:c1:d4, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:21:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-43316294-505d-43ed-9ae2-7f1566c713ea tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.090s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:49 user nova-compute[76049]: INFO nova.compute.manager [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Detaching volume 74ed4f7d-6fcc-434c-a93a-44a78c313ad5
Nov 15 11:21:49 user nova-compute[76049]: INFO nova.virt.block_device [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attempting to driver detach volume 74ed4f7d-6fcc-434c-a93a-44a78c313ad5 from mountpoint /dev/vdb
Nov 15 11:21:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Attempting to detach device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:21:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:21:49 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:21:49 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:21:49 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:21:49 user nova-compute[76049]:   <serial>74ed4f7d-6fcc-434c-a93a-44a78c313ad5</serial>
Nov 15 11:21:49 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:21:49 user nova-compute[76049]: </disk>
Nov 15 11:21:49 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:21:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config.
Nov 15 11:21:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:21:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:21:49 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:21:49 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:21:49 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:21:49 user nova-compute[76049]:   <serial>74ed4f7d-6fcc-434c-a93a-44a78c313ad5</serial>
Nov 15 11:21:49 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:21:49 user nova-compute[76049]: </disk>
Nov 15 11:21:49 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:21:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:21:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-changed-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Refreshing instance network info cache due to event network-changed-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:21:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] Acquiring lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:21:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] Acquired lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:21:56 user nova-compute[76049]: DEBUG nova.network.neutron [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Refreshing network info cache for port 5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.network.neutron [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Updated VIF entry in instance network info cache for port 5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.network.neutron [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Updating instance_info_cache with network_info: [{"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-42a01698-ab6b-441a-8b4e-c896956b3a63 req-27740fc9-ce7f-434d-834b-05309e8b5e62 service nova] Releasing lock "refresh_cache-c1efb824-016b-4903-8acd-5cef97ba4ee2" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "c1efb824-016b-4903-8acd-5cef97ba4ee2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:57 user nova-compute[76049]: INFO nova.compute.manager [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Terminating instance
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-5a1b2596-53b6-430d-ae53-98f48f589ff5 req-de7515ad-85ec-44f2-af0c-f46ae24afba8 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-vif-unplugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5a1b2596-53b6-430d-ae53-98f48f589ff5 req-de7515ad-85ec-44f2-af0c-f46ae24afba8 service nova] Acquiring lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5a1b2596-53b6-430d-ae53-98f48f589ff5 req-de7515ad-85ec-44f2-af0c-f46ae24afba8 service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5a1b2596-53b6-430d-ae53-98f48f589ff5 req-de7515ad-85ec-44f2-af0c-f46ae24afba8 service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-5a1b2596-53b6-430d-ae53-98f48f589ff5 req-de7515ad-85ec-44f2-af0c-f46ae24afba8 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] No waiting events found dispatching network-vif-unplugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-5a1b2596-53b6-430d-ae53-98f48f589ff5 req-de7515ad-85ec-44f2-af0c-f46ae24afba8 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-vif-unplugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Instance destroyed successfully.
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'resources' on Instance uuid c1efb824-016b-4903-8acd-5cef97ba4ee2 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1366753006',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1366753006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1366753006',id=33,image_ref='a3579eb3-2fce-4ec4-9b11-39819feec701',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFxB8o3FCmk4HmLyZzxWqOF6wOrooQO9DnKrkSrz/RYq0dovwLpxribR+myqVHKvCFQb76NrUyxRDtUWanTYSzDppzQSVkRNNXY6LPHUwUZDFbM6r1yKxy2syDUSjgnvQ==',key_name='tempest-keypair-1784257651',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-nizdtnpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2118546811',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac7d77f50629413bb7b6c9457156af67',uuid=c1efb824-016b-4903-8acd-5cef97ba4ee2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "address": "fa:16:3e:e5:05:a2", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc0524-fe", "ovs_interfaceid": "5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc0524-fe') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG os_vif [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc0524-fe') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bfc0524-fe, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38b2e135-0881-4f0a-ad94-6ac3c286dbd6) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:21:57 user nova-compute[76049]: INFO os_vif [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc0524-fe')
Nov 15 11:21:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrPwRkiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:21:57 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:21:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:21:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7571b1-c5e3-48d5-93f6-4e78d5dc7b6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:21:58 user nova-compute[76049]: No targets found.
Nov 15 11:21:58 user nova-compute[76049]: iSNS:
Nov 15 11:21:58 user nova-compute[76049]: No targets found.
Nov 15 11:21:58 user nova-compute[76049]: STATIC:
Nov 15 11:21:58 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5
Nov 15 11:21:58 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:58 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:58 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c
Nov 15 11:21:58 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:58 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:58 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:21:58 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:58 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:58 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:21:58 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:58 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:58 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:21:58 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:58 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:58 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:21:58 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:58 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:58 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:21:58 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:21:58 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:21:58 user nova-compute[76049]: FIRMWARE:
Nov 15 11:21:58 user nova-compute[76049]: No targets found.
Nov 15 11:21:58 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:21:58 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:21:58 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b23222-a08a-411f-894a-1a22460cd5d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b8c12-b957-458d-8649-0b63ccf9c48d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)
Nov 15 11:21:58 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629424ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c'): ({'sdj'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Removing single pathed devices sdj {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3088f85b-8d72-43c7-8192-9db8aea534cf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[88145eab-4c0d-4e1f-844b-e2bc4259d33c]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flushing IO for device /dev/sdj {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[061841b7-1717-43e9-af76-d97470d18c4f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.055s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb62c5d-b689-4764-88e7-235ae9e90b48]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] SCSI volumes sdj have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23239326439663939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c2290afe', '/dev/disk/by-id/scsi-1SCST_BIOc2290afe-292d9f99a2bf6ab7') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa108790-6463-4a1a-9884-ffba7effb6f9]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[efacd569-0e58-42c9-95cc-f3e1b8e0745d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c360de-974a-4b3f-a0a0-369ee5c119e8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260]
Nov 15 11:21:58 user nova-compute[76049]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c, portal: 172.16.0.220,3260] successful.
Nov 15 11:21:58 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f102fc8d-576a-4c14-b697-1338966f761c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[834affb9-795d-4053-9ac8-5fb6df43dd65]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== disconnect_volume: return (345ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:21:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Deleting instance files /opt/stack/data/nova/instances/c1efb824-016b-4903-8acd-5cef97ba4ee2_del
Nov 15 11:21:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Deletion of /opt/stack/data/nova/instances/c1efb824-016b-4903-8acd-5cef97ba4ee2_del complete
Nov 15 11:21:58 user nova-compute[76049]: INFO nova.compute.manager [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 11:21:58 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:21:58 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:21:59 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:21:59 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Took 0.92 seconds to deallocate network for instance.
Nov 15 11:21:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-03fe79c9-ae54-4123-b43e-abba7d9f39a5 req-2acaf897-68b3-44a6-86eb-8b796f54c175 service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-vif-deleted-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-90a60d21-69ca-428c-bb1a-80a73c6963bc req-5c635032-506d-4d00-a481-72d9e09c821b service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received event network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:21:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-90a60d21-69ca-428c-bb1a-80a73c6963bc req-5c635032-506d-4d00-a481-72d9e09c821b service nova] Acquiring lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:21:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-90a60d21-69ca-428c-bb1a-80a73c6963bc req-5c635032-506d-4d00-a481-72d9e09c821b service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:21:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-90a60d21-69ca-428c-bb1a-80a73c6963bc req-5c635032-506d-4d00-a481-72d9e09c821b service nova] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:21:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-90a60d21-69ca-428c-bb1a-80a73c6963bc req-5c635032-506d-4d00-a481-72d9e09c821b service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] No waiting events found dispatching network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:21:59 user nova-compute[76049]: WARNING nova.compute.manager [req-90a60d21-69ca-428c-bb1a-80a73c6963bc req-5c635032-506d-4d00-a481-72d9e09c821b service nova] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Received unexpected event network-vif-plugged-5bfc0524-fe0a-4b1a-bd11-f3e6a81e5c49 for instance with vm_state active and task_state deleting.
Nov 15 11:22:00 user nova-compute[76049]: INFO nova.compute.manager [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Took 0.76 seconds to detach 1 volumes for instance.
Nov 15 11:22:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: c1efb824-016b-4903-8acd-5cef97ba4ee2] Deleting volume: f102fc8d-576a-4c14-b697-1338966f761c {{(pid=76049) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 11:22:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:00 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:22:00 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:22:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:00 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Deleted allocations for instance c1efb824-016b-4903-8acd-5cef97ba4ee2
Nov 15 11:22:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1aad6d56-bea8-4472-bab5-99fe6d6e9d1d tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "c1efb824-016b-4903-8acd-5cef97ba4ee2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.614s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:09 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 is timed out.
Nov 15 11:22:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config.
Nov 15 11:22:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQgKPnkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:09 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[542349b9-d8ea-4f2a-b815-bf4be84dde03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:22:09 user nova-compute[76049]: No targets found.
Nov 15 11:22:09 user nova-compute[76049]: iSNS:
Nov 15 11:22:09 user nova-compute[76049]: No targets found.
Nov 15 11:22:09 user nova-compute[76049]: STATIC:
Nov 15 11:22:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5
Nov 15 11:22:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:22:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:22:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:22:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:22:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:22:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:09 user nova-compute[76049]: FIRMWARE:
Nov 15 11:22:09 user nova-compute[76049]: No targets found.
Nov 15 11:22:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:22:09 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:22:09 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b64ecb-f3c0-4a30-a436-cb8cec45d24d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[392c9611-66cd-40f0-8b6a-0f91c92d9deb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 (non-flash)
Nov 15 11:22:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629c0a09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[64243a82-2a98-4282-8d51-f93fd5eaca25]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bcff1a-ee98-44e0-b330-de645e87470c]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c576a9b8-ab0f-4a4b-bfee-0b756019dfcd]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3846d2-9245-4e94-aaec-7d7c5d2d5181]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829450e-d706-4ce6-9b98-5bcda8007110]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bbc5c3-a1b4-4011-a4f9-5cdf5416233c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260]
Nov 15 11:22:10 user nova-compute[76049]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5, portal: 172.16.0.220,3260] successful.
Nov 15 11:22:10 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ed4f7d-6fcc-434c-a93a-44a78c313ad5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8993113-7543-4b19-9046-b965f05aadff]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== disconnect_volume: return (324ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9f6e8638-8f55-44c1-aba1-e5d0629fd96f tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.643s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:11 user nova-compute[76049]: INFO nova.compute.manager [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Detaching volume 67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:22:11 user nova-compute[76049]: INFO nova.virt.block_device [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Attempting to driver detach volume 67d0eb55-f1ad-403d-b387-cb5788104926 from mountpoint /dev/vdb
Nov 15 11:22:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Attempting to detach device vdb from instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:22:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:22:11 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:22:11 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:22:11 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:22:11 user nova-compute[76049]:   <serial>67d0eb55-f1ad-403d-b387-cb5788104926</serial>
Nov 15 11:22:11 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:22:11 user nova-compute[76049]: </disk>
Nov 15 11:22:11 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:22:11 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully detached device vdb from instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa from the persistent domain config.
Nov 15 11:22:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:22:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:22:11 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:22:11 user nova-compute[76049]:   <source dev="/dev/sdi"/>
Nov 15 11:22:11 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:22:11 user nova-compute[76049]:   <serial>67d0eb55-f1ad-403d-b387-cb5788104926</serial>
Nov 15 11:22:11 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 11:22:11 user nova-compute[76049]: </disk>
Nov 15 11:22:11 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:22:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:22:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-changed-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Refreshing instance network info cache due to event network-changed-577ca24b-c6f0-4330-a336-5c31c162cb8e. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:22:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] Acquiring lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:22:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] Acquired lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:22:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Refreshing network info cache for port 577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG nova.network.neutron [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Updated VIF entry in instance network info cache for port 577ca24b-c6f0-4330-a336-5c31c162cb8e. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG nova.network.neutron [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Updating instance_info_cache with network_info: [{"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-51344179-3e01-42e1-a75d-64f9a7482bed req-b002bd3e-5789-4ee7-8462-87dd16f99312 service nova] Releasing lock "refresh_cache-6367e8f8-6189-4498-8626-1c4836957c11" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6367e8f8-6189-4498-8626-1c4836957c11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6367e8f8-6189-4498-8626-1c4836957c11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6367e8f8-6189-4498-8626-1c4836957c11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:13 user nova-compute[76049]: INFO nova.compute.manager [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Terminating instance
Nov 15 11:22:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-8f48f264-42f4-489f-9d30-8518876409e8 req-838c738a-38ce-4378-9ccc-bc51dbcf8c3b service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-vif-unplugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8f48f264-42f4-489f-9d30-8518876409e8 req-838c738a-38ce-4378-9ccc-bc51dbcf8c3b service nova] Acquiring lock "6367e8f8-6189-4498-8626-1c4836957c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8f48f264-42f4-489f-9d30-8518876409e8 req-838c738a-38ce-4378-9ccc-bc51dbcf8c3b service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8f48f264-42f4-489f-9d30-8518876409e8 req-838c738a-38ce-4378-9ccc-bc51dbcf8c3b service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-8f48f264-42f4-489f-9d30-8518876409e8 req-838c738a-38ce-4378-9ccc-bc51dbcf8c3b service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] No waiting events found dispatching network-vif-unplugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG nova.compute.manager [req-8f48f264-42f4-489f-9d30-8518876409e8 req-838c738a-38ce-4378-9ccc-bc51dbcf8c3b service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-vif-unplugged-577ca24b-c6f0-4330-a336-5c31c162cb8e for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Instance destroyed successfully.
Nov 15 11:22:14 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'resources' on Instance uuid 6367e8f8-6189-4498-8626-1c4836957c11 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1993752648',display_name='tempest-AttachVolumeNegativeTest-server-1993752648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1993752648',id=34,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8tw90gUAtyV0Fo18F63gVOn96AVJcFVpG9bGDuMwRL9QfxNAO0he4vmGeKWJBQoNO5o9qoq9vWamstIBNU9YlwPtpVauL9IxJeK8E1SmMy16r0+mFU+hEJ4gHSqyTGww==',key_name='tempest-keypair-1698852172',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-nfg3zo19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=6367e8f8-6189-4498-8626-1c4836957c11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "address": "fa:16:3e:40:f9:7e", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577ca24b-c6", "ovs_interfaceid": "577ca24b-c6f0-4330-a336-5c31c162cb8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:f9:7e,bridge_name='br-int',has_traffic_filtering=True,id=577ca24b-c6f0-4330-a336-5c31c162cb8e,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577ca24b-c6') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG os_vif [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:f9:7e,bridge_name='br-int',has_traffic_filtering=True,id=577ca24b-c6f0-4330-a336-5c31c162cb8e,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577ca24b-c6') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap577ca24b-c6, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7323237-917f-4895-87e1-2036e4a53a28) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:14 user nova-compute[76049]: INFO os_vif [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:f9:7e,bridge_name='br-int',has_traffic_filtering=True,id=577ca24b-c6f0-4330-a336-5c31c162cb8e,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577ca24b-c6')
Nov 15 11:22:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Deleting instance files /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11_del
Nov 15 11:22:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Deletion of /opt/stack/data/nova/instances/6367e8f8-6189-4498-8626-1c4836957c11_del complete
Nov 15 11:22:14 user nova-compute[76049]: INFO nova.compute.manager [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 11:22:14 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:22:14 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:14 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Took 0.79 seconds to deallocate network for instance.
Nov 15 11:22:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-68ec2331-4b8c-4835-a0dd-dacc509b0b55 req-171703e9-6bd9-4370-a8f0-0c93a235ce8c service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-vif-deleted-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:15 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Deleted allocations for instance 6367e8f8-6189-4498-8626-1c4836957c11
Nov 15 11:22:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a82178a6-6705-41aa-97e7-f698e558e10a tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6367e8f8-6189-4498-8626-1c4836957c11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-33e55653-0b79-4b53-ba70-879df428fb96 req-1e1a8f9f-805c-47f7-8b7e-1aaf5613d93c service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received event network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-33e55653-0b79-4b53-ba70-879df428fb96 req-1e1a8f9f-805c-47f7-8b7e-1aaf5613d93c service nova] Acquiring lock "6367e8f8-6189-4498-8626-1c4836957c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-33e55653-0b79-4b53-ba70-879df428fb96 req-1e1a8f9f-805c-47f7-8b7e-1aaf5613d93c service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-33e55653-0b79-4b53-ba70-879df428fb96 req-1e1a8f9f-805c-47f7-8b7e-1aaf5613d93c service nova] Lock "6367e8f8-6189-4498-8626-1c4836957c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:15 user nova-compute[76049]: DEBUG nova.compute.manager [req-33e55653-0b79-4b53-ba70-879df428fb96 req-1e1a8f9f-805c-47f7-8b7e-1aaf5613d93c service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] No waiting events found dispatching network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:15 user nova-compute[76049]: WARNING nova.compute.manager [req-33e55653-0b79-4b53-ba70-879df428fb96 req-1e1a8f9f-805c-47f7-8b7e-1aaf5613d93c service nova] [instance: 6367e8f8-6189-4498-8626-1c4836957c11] Received unexpected event network-vif-plugged-577ca24b-c6f0-4330-a336-5c31c162cb8e for instance with vm_state deleted and task_state None.
Nov 15 11:22:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Port 0495d054-d8d9-4a64-8306-3ae999cdb253 binding to destination host user is already ACTIVE {{(pid=76049) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquired lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Releasing lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Creating tmpfile /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/tmpfs21r1hu to verify with other compute node that the instance is on the same shared storage. {{(pid=76049) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-0b757f0f-062d-4d2a-ba08-5144711da1b7 req-58a5b245-6e6c-4396-bcc7-2ecbe0e3b9f6 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b757f0f-062d-4d2a-ba08-5144711da1b7 req-58a5b245-6e6c-4396-bcc7-2ecbe0e3b9f6 service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b757f0f-062d-4d2a-ba08-5144711da1b7 req-58a5b245-6e6c-4396-bcc7-2ecbe0e3b9f6 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0b757f0f-062d-4d2a-ba08-5144711da1b7 req-58a5b245-6e6c-4396-bcc7-2ecbe0e3b9f6 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.compute.manager [req-0b757f0f-062d-4d2a-ba08-5144711da1b7 req-58a5b245-6e6c-4396-bcc7-2ecbe0e3b9f6 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:17 user nova-compute[76049]: WARNING nova.compute.manager [req-0b757f0f-062d-4d2a-ba08-5144711da1b7 req-58a5b245-6e6c-4396-bcc7-2ecbe0e3b9f6 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state resized and task_state resize_reverting.
Nov 15 11:22:17 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance destroyed successfully.
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lazy-loading 'resources' on Instance uuid 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_vif [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0495d054-d8, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7263511f-6b8f-48a9-adaf-d0f652d3ca4f) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: INFO os_vif [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8')
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:17 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc28a4-eccb-403b-a1d5-03826599ed6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:22:17 user nova-compute[76049]: No targets found.
Nov 15 11:22:17 user nova-compute[76049]: iSNS:
Nov 15 11:22:17 user nova-compute[76049]: No targets found.
Nov 15 11:22:17 user nova-compute[76049]: STATIC:
Nov 15 11:22:17 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:22:17 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:17 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:17 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:22:17 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:17 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:17 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:22:17 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:17 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:17 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:22:17 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:17 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:17 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:22:17 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:17 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:17 user nova-compute[76049]: FIRMWARE:
Nov 15 11:22:17 user nova-compute[76049]: No targets found.
Nov 15 11:22:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:22:17 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:22:17 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6e884-fc1b-4bcf-bf4c-11ae79e72ca4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[66716373-b780-4b48-aa03-86b9356e1519]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607284c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b286c5f7-fd3a-41e9-8294-08191c816d13]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a48aa79-1b42-4fb4-815d-fc02cf92cbe8]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[040888b5-5f1f-45fa-8f8d-4216bc7d5339]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[390f7332-b9c6-4d17-aff2-5ffcd05d74ee]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11eb997-d03f-4a7f-9637-8be6cf7c3c76]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f06c1fc-0d8b-4e15-93c8-fee6eecd83fc]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]
Nov 15 11:22:17 user nova-compute[76049]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.
Nov 15 11:22:17 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85eb0f0-b6f5-46e2-b0b7-2778088f0e9f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== disconnect_volume: return (315ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:17 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-739244cd-7dc7-4c7b-9772-c3958b409002 req-1612aa5a-8873-4d4e-a4e6-0f1de072ab25 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-739244cd-7dc7-4c7b-9772-c3958b409002 req-1612aa5a-8873-4d4e-a4e6-0f1de072ab25 service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-739244cd-7dc7-4c7b-9772-c3958b409002 req-1612aa5a-8873-4d4e-a4e6-0f1de072ab25 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-739244cd-7dc7-4c7b-9772-c3958b409002 req-1612aa5a-8873-4d4e-a4e6-0f1de072ab25 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-739244cd-7dc7-4c7b-9772-c3958b409002 req-1612aa5a-8873-4d4e-a4e6-0f1de072ab25 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:19 user nova-compute[76049]: WARNING nova.compute.manager [req-739244cd-7dc7-4c7b-9772-c3958b409002 req-1612aa5a-8873-4d4e-a4e6-0f1de072ab25 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state resized and task_state resize_reverting.
Nov 15 11:22:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lazy-loading 'migration_context' on Instance uuid 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG nova.objects.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Object Instance<6625217c-b0a0-48c1-972c-f460acd20013> lazy-loaded attributes: resources,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:22:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.508s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:19 user nova-compute[76049]: INFO nova.compute.manager [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Swapping old allocation on dict_keys(['260aaae9-3cc3-45eb-be88-21bcfcddde10']) held by migration 0c2417cc-e54d-4564-acc2-fc0811890574 for instance
Nov 15 11:22:20 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Overwriting current allocation {'allocations': {'260aaae9-3cc3-45eb-be88-21bcfcddde10': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 42}}, 'project_id': '8953f0ed0ac04badb593529ffb2c567c', 'user_id': 'dfc6846a39a4455798a857842912c534', 'consumer_generation': 1} on consumer 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquired lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG nova.network.neutron [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Releasing lock "refresh_cache-6625217c-b0a0-48c1-972c-f460acd20013" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG os_brick.utils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ccb4cd-c9cf-4a07-aafc-3d654889f150]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd69727-fe37-4351-aada-7d2c514351a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de49a3b-9b8c-4acf-8965-829754b809dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b4447b-7c68-453b-b75e-89b39d7339af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:22:20 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:22:20 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[185b0132-664f-4341-91f3-1002d9184256]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:22:20 user nova-compute[76049]: DEBUG os_brick.utils [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:25 user nova-compute[76049]: INFO nova.compute.manager [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Terminating instance
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Starting finish_revert_migration {{(pid=76049) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Start _get_guest_xml network_info=[{"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6625217c-b0a0-48c1-972c-f460acd20013', 'attached_at': '2023-11-15T11:22:26.000000', 'detached_at': '', 'volume_id': 'a4acd1da-cc65-4716-825f-f4b4ed278581', 'serial': 'a4acd1da-cc65-4716-825f-f4b4ed278581'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'cabe9971-2993-40cd-b468-64a5065c5c9b', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:25 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:25 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:25 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:22:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[370f5f1f-9c79-41c0-b52a-eed5bd96b353]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:22:25 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a54ed-6dc9-4271-b3f9-8401d031a0bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581] added
Nov 15 11:22:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba2078e-f19f-46d7-97a6-b8030e623afc]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-469f1184-bb08-4b29-832e-45331b1c4faa req-481ddd08-35c0-4b82-8def-6ffeabe01210 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-469f1184-bb08-4b29-832e-45331b1c4faa req-481ddd08-35c0-4b82-8def-6ffeabe01210 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-469f1184-bb08-4b29-832e-45331b1c4faa req-481ddd08-35c0-4b82-8def-6ffeabe01210 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-469f1184-bb08-4b29-832e-45331b1c4faa req-481ddd08-35c0-4b82-8def-6ffeabe01210 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-469f1184-bb08-4b29-832e-45331b1c4faa req-481ddd08-35c0-4b82-8def-6ffeabe01210 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-469f1184-bb08-4b29-832e-45331b1c4faa req-481ddd08-35c0-4b82-8def-6ffeabe01210 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-unplugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a16c5-9bcd-46e8-ab23-601232fb7e66]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiWFmkwh {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiWFmkwh" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48aa793-f5a3-43eb-ad70-874a231c7dae]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiWFmkwh'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6ddf80-7086-4035-9c18-bdb2f7ca9466]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb81fe78-3e0a-499e-8423-847d3ca2f1e1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6674bf-e17d-4263-bf76-680edcf10f2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]
Nov 15 11:22:26 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.
Nov 15 11:22:26 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[35526fd3-1647-493d-8d17-135199099fd6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cf8622-a07e-4a88-bcd8-f753d37ad799]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:26 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d696d20-cdf0-440f-8b0c-5c6e0362b23b]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:22:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Instance destroyed successfully.
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lazy-loading 'resources' on Instance uuid 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331075314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331075314',id=27,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowPv+zeh5HeWFO2gWyNt655P1rLuxk9JkH05BReuni5hPcufErhaST6j3jqwNsidl8IFiUqJYYff9h02deDf9bJZdZhCLQ4n6wIW3pKPWRiijmwQyhFNj7kfO0p7Dmsg==',key_name='tempest-keypair-1390670603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:20:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4977c566adae433e8780d44d86f18757',ramdisk_id='',reservation_id='r-a30rqbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-10410443',owner_user_name='tempest-AttachVolumeShelveTestJSON-10410443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cb19baf044c1ca816581576c5c243',uuid=644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converting VIF {"id": "3681d118-3073-4666-bcc9-39f1b4b7694f", "address": "fa:16:3e:af:4e:e7", "network": {"id": "d168a919-094f-43c9-a045-4fa5536dd5e4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-102348554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4977c566adae433e8780d44d86f18757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3681d118-30", "ovs_interfaceid": "3681d118-3073-4666-bcc9-39f1b4b7694f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG os_vif [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3681d118-30, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6073f57-7193-41e6-95a4-5610103ffc76) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:26 user nova-compute[76049]: INFO os_vif [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3681d118-3073-4666-bcc9-39f1b4b7694f,network=Network(d168a919-094f-43c9-a045-4fa5536dd5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3681d118-30')
Nov 15 11:22:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Deleting instance files /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc_del
Nov 15 11:22:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Deletion of /opt/stack/data/nova/instances/644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc_del complete
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:26 user nova-compute[76049]: INFO nova.compute.manager [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:26 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:22:26 user nova-compute[76049]: INFO nova.compute.claims [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Claim successful on node user
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26261663362323832', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261663362323832', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:22:27 user nova-compute[76049]:   <uuid>6625217c-b0a0-48c1-972c-f460acd20013</uuid>
Nov 15 11:22:27 user nova-compute[76049]:   <name>instance-0000001a</name>
Nov 15 11:22:27 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:22:27 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:22:27 user nova-compute[76049]:   <metadata>
Nov 15 11:22:27 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:22:27 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:22:27 user nova-compute[76049]:       <nova:name>tempest-ServerActionsTestOtherB-server-1158016788</nova:name>
Nov 15 11:22:27 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:22:25</nova:creationTime>
Nov 15 11:22:27 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:22:27 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:22:27 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:22:27 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:22:27 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:22:27 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:22:27 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:22:27 user nova-compute[76049]:       <nova:owner>
Nov 15 11:22:27 user nova-compute[76049]:         <nova:user uuid="dfc6846a39a4455798a857842912c534">tempest-ServerActionsTestOtherB-1283239424-project-member</nova:user>
Nov 15 11:22:27 user nova-compute[76049]:         <nova:project uuid="8953f0ed0ac04badb593529ffb2c567c">tempest-ServerActionsTestOtherB-1283239424</nova:project>
Nov 15 11:22:27 user nova-compute[76049]:       </nova:owner>
Nov 15 11:22:27 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:22:27 user nova-compute[76049]:       <nova:ports>
Nov 15 11:22:27 user nova-compute[76049]:         <nova:port uuid="0495d054-d8d9-4a64-8306-3ae999cdb253">
Nov 15 11:22:27 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 11:22:27 user nova-compute[76049]:         </nova:port>
Nov 15 11:22:27 user nova-compute[76049]:       </nova:ports>
Nov 15 11:22:27 user nova-compute[76049]:     </nova:instance>
Nov 15 11:22:27 user nova-compute[76049]:   </metadata>
Nov 15 11:22:27 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:22:27 user nova-compute[76049]:     <system>
Nov 15 11:22:27 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:22:27 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:22:27 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:22:27 user nova-compute[76049]:       <entry name="serial">6625217c-b0a0-48c1-972c-f460acd20013</entry>
Nov 15 11:22:27 user nova-compute[76049]:       <entry name="uuid">6625217c-b0a0-48c1-972c-f460acd20013</entry>
Nov 15 11:22:27 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:22:27 user nova-compute[76049]:     </system>
Nov 15 11:22:27 user nova-compute[76049]:   </sysinfo>
Nov 15 11:22:27 user nova-compute[76049]:   <os>
Nov 15 11:22:27 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:22:27 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:22:27 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:22:27 user nova-compute[76049]:   </os>
Nov 15 11:22:27 user nova-compute[76049]:   <features>
Nov 15 11:22:27 user nova-compute[76049]:     <acpi/>
Nov 15 11:22:27 user nova-compute[76049]:     <apic/>
Nov 15 11:22:27 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:22:27 user nova-compute[76049]:   </features>
Nov 15 11:22:27 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:22:27 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:22:27 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:22:27 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:22:27 user nova-compute[76049]:   </clock>
Nov 15 11:22:27 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:22:27 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:22:27 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:22:27 user nova-compute[76049]:   </cpu>
Nov 15 11:22:27 user nova-compute[76049]:   <devices>
Nov 15 11:22:27 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:22:27 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:22:27 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk"/>
Nov 15 11:22:27 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:22:27 user nova-compute[76049]:     </disk>
Nov 15 11:22:27 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:22:27 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:22:27 user nova-compute[76049]:       <source dev="/dev/sdb"/>
Nov 15 11:22:27 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:22:27 user nova-compute[76049]:       <serial>a4acd1da-cc65-4716-825f-f4b4ed278581</serial>
Nov 15 11:22:27 user nova-compute[76049]:     </disk>
Nov 15 11:22:27 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:22:27 user nova-compute[76049]:       <mac address="fa:16:3e:88:80:29"/>
Nov 15 11:22:27 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:22:27 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:22:27 user nova-compute[76049]:       <target dev="tap0495d054-d8"/>
Nov 15 11:22:27 user nova-compute[76049]:     </interface>
Nov 15 11:22:27 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:22:27 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/console.log" append="off"/>
Nov 15 11:22:27 user nova-compute[76049]:     </serial>
Nov 15 11:22:27 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:22:27 user nova-compute[76049]:     <video>
Nov 15 11:22:27 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:22:27 user nova-compute[76049]:     </video>
Nov 15 11:22:27 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:22:27 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:22:27 user nova-compute[76049]:     </rng>
Nov 15 11:22:27 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:22:27 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:22:27 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:22:27 user nova-compute[76049]:     </memballoon>
Nov 15 11:22:27 user nova-compute[76049]:   </devices>
Nov 15 11:22:27 user nova-compute[76049]: </domain>
Nov 15 11:22:27 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG os_vif [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16e507b6-9089-50c9-81d7-056d3db5bf92', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0495d054-d8, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0495d054-d8, col_values=(('qos', UUID('ff515d37-3693-42e0-a9af-eced9b4f07fc')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0495d054-d8, col_values=(('external_ids', {'iface-id': '0495d054-d8d9-4a64-8306-3ae999cdb253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:80:29', 'vm-uuid': '6625217c-b0a0-48c1-972c-f460acd20013'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:27 user nova-compute[76049]: INFO os_vif [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8')
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:22:27 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.policy [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9846cdf834fe438e822035561c81d2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d017cbd24f46a9b371b9ba33dd9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:27 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Took 1.04 seconds to deallocate network for instance.
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:22:27 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Creating image(s)
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "/opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "/opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "/opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.070s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "a26781926de5956f28972bcb0be89ad8aade90e5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a26781926de5956f28972bcb0be89ad8aade90e5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d9ace48-24d2-48d4-bd51-49ba1750e6f1 req-420eb19f-3220-4f3a-a7ff-6c6b66c84f85 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d9ace48-24d2-48d4-bd51-49ba1750e6f1 req-420eb19f-3220-4f3a-a7ff-6c6b66c84f85 service nova] Acquiring lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d9ace48-24d2-48d4-bd51-49ba1750e6f1 req-420eb19f-3220-4f3a-a7ff-6c6b66c84f85 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d9ace48-24d2-48d4-bd51-49ba1750e6f1 req-420eb19f-3220-4f3a-a7ff-6c6b66c84f85 service nova] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d9ace48-24d2-48d4-bd51-49ba1750e6f1 req-420eb19f-3220-4f3a-a7ff-6c6b66c84f85 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] No waiting events found dispatching network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:28 user nova-compute[76049]: WARNING nova.compute.manager [req-5d9ace48-24d2-48d4-bd51-49ba1750e6f1 req-420eb19f-3220-4f3a-a7ff-6c6b66c84f85 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received unexpected event network-vif-plugged-3681d118-3073-4666-bcc9-39f1b4b7694f for instance with vm_state deleted and task_state None.
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d9ace48-24d2-48d4-bd51-49ba1750e6f1 req-420eb19f-3220-4f3a-a7ff-6c6b66c84f85 service nova] [instance: 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc] Received event network-vif-deleted-3681d118-3073-4666-bcc9-39f1b4b7694f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Skipping network cache update for instance because it is Building. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid d0f0287a-5e2c-4a02-8490-da45ae1e86b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.part --force-share --output=json" returned: 0 in 0.263s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.virt.images [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] b88b823c-45c9-4774-9fb6-a13081db84a9 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.part /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Successfully created port: 195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.part /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.converted" returned: 0 in 0.322s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.284s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a26781926de5956f28972bcb0be89ad8aade90e5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.358s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:29 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Deleted allocations for instance 644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c57ccac5-66ee-4bba-a1ff-079dcac59e2f tempest-AttachVolumeShelveTestJSON-10410443 tempest-AttachVolumeShelveTestJSON-10410443-project-member] Lock "644c83cf-e8c6-4fe8-b9bf-32dc8ade82cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.643s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5 --force-share --output=json" returned: 0 in 0.266s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "a26781926de5956f28972bcb0be89ad8aade90e5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a26781926de5956f28972bcb0be89ad8aade90e5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-8b308802-8974-4dc3-848d-6f8734c19098 req-e194d27e-96dd-4a50-9044-2bd141954a33 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b308802-8974-4dc3-848d-6f8734c19098 req-e194d27e-96dd-4a50-9044-2bd141954a33 service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b308802-8974-4dc3-848d-6f8734c19098 req-e194d27e-96dd-4a50-9044-2bd141954a33 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8b308802-8974-4dc3-848d-6f8734c19098 req-e194d27e-96dd-4a50-9044-2bd141954a33 service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-8b308802-8974-4dc3-848d-6f8734c19098 req-e194d27e-96dd-4a50-9044-2bd141954a33 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:29 user nova-compute[76049]: WARNING nova.compute.manager [req-8b308802-8974-4dc3-848d-6f8734c19098 req-e194d27e-96dd-4a50-9044-2bd141954a33 service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state resized and task_state resize_reverting.
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5 --force-share --output=json" returned: 0 in 0.231s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5,backing_fmt=raw /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updating instance_info_cache with network_info: [{"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5,backing_fmt=raw /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk 1073741824" returned: 0 in 0.052s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "a26781926de5956f28972bcb0be89ad8aade90e5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5 --force-share --output=json" returned: 0 in 0.212s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Successfully updated port: 195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquired lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:22:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Cannot resize image /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Ensure instance console log exists: /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Releasing lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance network_info: |[{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Start _get_guest_xml network_info=[{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:22:24Z,direct_url=<?>,disk_format='qcow2',id=b88b823c-45c9-4774-9fb6-a13081db84a9,min_disk=0,min_ram=0,name='tempest-scenario-img--1746487873',owner='78d017cbd24f46a9b371b9ba33dd9abb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:22:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': 'b88b823c-45c9-4774-9fb6-a13081db84a9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:22:30 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:30 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:22:24Z,direct_url=<?>,disk_format='qcow2',id=b88b823c-45c9-4774-9fb6-a13081db84a9,min_disk=0,min_ram=0,name='tempest-scenario-img--1746487873',owner='78d017cbd24f46a9b371b9ba33dd9abb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:22:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1000412488',display_name='tempest-TestMinimumBasicScenario-server-1000412488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1000412488',id=36,image_ref='b88b823c-45c9-4774-9fb6-a13081db84a9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlm9Tt5GzFw4iBJs2uP/hpIc9eMYli92hLiYI156oq9dgItF1s+j7mA4Gvl0ZetRv1EWrQ2zlkt5fIBEbxwrWlFlLVPCrgNFm/lgbOGTSVT/4B+qQmcNEMfPh+6/s3QJQ==',key_name='tempest-TestMinimumBasicScenario-31455806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-1i0qb9uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b88b823c-45c9-4774-9fb6-a13081db84a9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:22:28Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=79b1e190-6f5c-4546-88de-31d8a3ec36b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:b7:82,bridge_name='br-int',has_traffic_filtering=True,id=195816f3-6635-4db5-9eab-aed97c980ce9,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195816f3-66') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'pci_devices' on Instance uuid 79b1e190-6f5c-4546-88de-31d8a3ec36b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:22:30 user nova-compute[76049]:   <uuid>79b1e190-6f5c-4546-88de-31d8a3ec36b9</uuid>
Nov 15 11:22:30 user nova-compute[76049]:   <name>instance-00000024</name>
Nov 15 11:22:30 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:22:30 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:22:30 user nova-compute[76049]:   <metadata>
Nov 15 11:22:30 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:22:30 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:22:30 user nova-compute[76049]:       <nova:name>tempest-TestMinimumBasicScenario-server-1000412488</nova:name>
Nov 15 11:22:30 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:22:30</nova:creationTime>
Nov 15 11:22:30 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:22:30 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:22:30 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:22:30 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:22:30 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:22:30 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:22:30 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:22:30 user nova-compute[76049]:       <nova:owner>
Nov 15 11:22:30 user nova-compute[76049]:         <nova:user uuid="9846cdf834fe438e822035561c81d2d8">tempest-TestMinimumBasicScenario-739422793-project-member</nova:user>
Nov 15 11:22:30 user nova-compute[76049]:         <nova:project uuid="78d017cbd24f46a9b371b9ba33dd9abb">tempest-TestMinimumBasicScenario-739422793</nova:project>
Nov 15 11:22:30 user nova-compute[76049]:       </nova:owner>
Nov 15 11:22:30 user nova-compute[76049]:       <nova:root type="image" uuid="b88b823c-45c9-4774-9fb6-a13081db84a9"/>
Nov 15 11:22:30 user nova-compute[76049]:       <nova:ports>
Nov 15 11:22:30 user nova-compute[76049]:         <nova:port uuid="195816f3-6635-4db5-9eab-aed97c980ce9">
Nov 15 11:22:30 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 11:22:30 user nova-compute[76049]:         </nova:port>
Nov 15 11:22:30 user nova-compute[76049]:       </nova:ports>
Nov 15 11:22:30 user nova-compute[76049]:     </nova:instance>
Nov 15 11:22:30 user nova-compute[76049]:   </metadata>
Nov 15 11:22:30 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:22:30 user nova-compute[76049]:     <system>
Nov 15 11:22:30 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:22:30 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:22:30 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:22:30 user nova-compute[76049]:       <entry name="serial">79b1e190-6f5c-4546-88de-31d8a3ec36b9</entry>
Nov 15 11:22:30 user nova-compute[76049]:       <entry name="uuid">79b1e190-6f5c-4546-88de-31d8a3ec36b9</entry>
Nov 15 11:22:30 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:22:30 user nova-compute[76049]:     </system>
Nov 15 11:22:30 user nova-compute[76049]:   </sysinfo>
Nov 15 11:22:30 user nova-compute[76049]:   <os>
Nov 15 11:22:30 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:22:30 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:22:30 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:22:30 user nova-compute[76049]:   </os>
Nov 15 11:22:30 user nova-compute[76049]:   <features>
Nov 15 11:22:30 user nova-compute[76049]:     <acpi/>
Nov 15 11:22:30 user nova-compute[76049]:     <apic/>
Nov 15 11:22:30 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:22:30 user nova-compute[76049]:   </features>
Nov 15 11:22:30 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:22:30 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:22:30 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:22:30 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:22:30 user nova-compute[76049]:   </clock>
Nov 15 11:22:30 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:22:30 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:22:30 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:22:30 user nova-compute[76049]:   </cpu>
Nov 15 11:22:30 user nova-compute[76049]:   <devices>
Nov 15 11:22:30 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:22:30 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:22:30 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk"/>
Nov 15 11:22:30 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:22:30 user nova-compute[76049]:     </disk>
Nov 15 11:22:30 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:22:30 user nova-compute[76049]:       <mac address="fa:16:3e:39:b7:82"/>
Nov 15 11:22:30 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:22:30 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:22:30 user nova-compute[76049]:       <target dev="tap195816f3-66"/>
Nov 15 11:22:30 user nova-compute[76049]:     </interface>
Nov 15 11:22:30 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:22:30 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/console.log" append="off"/>
Nov 15 11:22:30 user nova-compute[76049]:     </serial>
Nov 15 11:22:30 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:22:30 user nova-compute[76049]:     <video>
Nov 15 11:22:30 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:22:30 user nova-compute[76049]:     </video>
Nov 15 11:22:30 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:22:30 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:22:30 user nova-compute[76049]:     </rng>
Nov 15 11:22:30 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:22:30 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:22:30 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:22:30 user nova-compute[76049]:     </memballoon>
Nov 15 11:22:30 user nova-compute[76049]:   </devices>
Nov 15 11:22:30 user nova-compute[76049]: </domain>
Nov 15 11:22:30 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1000412488',display_name='tempest-TestMinimumBasicScenario-server-1000412488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1000412488',id=36,image_ref='b88b823c-45c9-4774-9fb6-a13081db84a9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlm9Tt5GzFw4iBJs2uP/hpIc9eMYli92hLiYI156oq9dgItF1s+j7mA4Gvl0ZetRv1EWrQ2zlkt5fIBEbxwrWlFlLVPCrgNFm/lgbOGTSVT/4B+qQmcNEMfPh+6/s3QJQ==',key_name='tempest-TestMinimumBasicScenario-31455806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-1i0qb9uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b88b823c-45c9-4774-9fb6-a13081db84a9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:22:28Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=79b1e190-6f5c-4546-88de-31d8a3ec36b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:b7:82,bridge_name='br-int',has_traffic_filtering=True,id=195816f3-6635-4db5-9eab-aed97c980ce9,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195816f3-66') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG os_vif [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:b7:82,bridge_name='br-int',has_traffic_filtering=True,id=195816f3-6635-4db5-9eab-aed97c980ce9,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195816f3-66') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '000cc13c-b5ac-53d2-93f4-be70a9c87a92', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195816f3-66, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap195816f3-66, col_values=(('qos', UUID('0e1cc87f-00ca-43b2-9b95-359f239acace')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap195816f3-66, col_values=(('external_ids', {'iface-id': '195816f3-6635-4db5-9eab-aed97c980ce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:b7:82', 'vm-uuid': '79b1e190-6f5c-4546-88de-31d8a3ec36b9'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:30 user nova-compute[76049]: INFO os_vif [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:b7:82,bridge_name='br-int',has_traffic_filtering=True,id=195816f3-6635-4db5-9eab-aed97c980ce9,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195816f3-66')
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:22:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No VIF found with MAC fa:16:3e:39:b7:82, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:22:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance running successfully.
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] finish_revert_migration finished successfully. {{(pid=76049) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 11:22:31 user nova-compute[76049]: INFO nova.compute.manager [None req-7d0df6bc-709e-408d-92b6-d1d30dc895fc tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance to original state: 'active'
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:31 user nova-compute[76049]: WARNING nova.compute.manager [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state resized and task_state resize_reverting.
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing instance network info cache due to event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] Acquiring lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] Acquired lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:22:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa is timed out.
Nov 15 11:22:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully detached device vdb from instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa from the live domain config.
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDUJFpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[702bc16c-e072-42a2-8338-ec72dea07e8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:22:31 user nova-compute[76049]: No targets found.
Nov 15 11:22:31 user nova-compute[76049]: iSNS:
Nov 15 11:22:31 user nova-compute[76049]: No targets found.
Nov 15 11:22:31 user nova-compute[76049]: STATIC:
Nov 15 11:22:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:22:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926
Nov 15 11:22:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:22:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:22:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:22:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:31 user nova-compute[76049]: FIRMWARE:
Nov 15 11:22:31 user nova-compute[76049]: No targets found.
Nov 15 11:22:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:22:31 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:22:31 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[843a6c33-de04-49cb-a1ac-019b24fbdf64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5188a2c-0164-441c-b9c2-ee90f0380d7f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62942bb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926'): ({'sdi'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Removing single pathed devices sdi {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updated VIF entry in instance network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ff3f63-a786-4b42-9c61-9f26eabccbdc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-545515e4-dbd2-4412-9d71-b96108877170 req-acd1267c-ae64-46e8-aa5f-62a2fb57282b service nova] Releasing lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155aecd-ce7e-4151-84e9-4f07db17aa4c]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flushing IO for device /dev/sdi {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:22:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9225a531-74ed-450a-965c-e34acda644f5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd1452b-f2d6-485d-b49a-d7ebff4b57aa]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] SCSI volumes sdi have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2fdfc3-0ba8-4710-a912-0532cc4b60ba]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8837e8-12f0-479d-a167-efeeb237de94]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260]
Nov 15 11:22:32 user nova-compute[76049]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926, portal: 172.16.0.220,3260] successful.
Nov 15 11:22:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d0eb55-f1ad-403d-b387-cb5788104926 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac18d97-8efe-4541-8943-dfdb5025572b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== disconnect_volume: return (397ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-d3069ba7-8ffe-44f4-b020-251b0f5a573c req-d658efa2-10f7-4832-b3a9-be4782fa5378 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d3069ba7-8ffe-44f4-b020-251b0f5a573c req-d658efa2-10f7-4832-b3a9-be4782fa5378 service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d3069ba7-8ffe-44f4-b020-251b0f5a573c req-d658efa2-10f7-4832-b3a9-be4782fa5378 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d3069ba7-8ffe-44f4-b020-251b0f5a573c req-d658efa2-10f7-4832-b3a9-be4782fa5378 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-d3069ba7-8ffe-44f4-b020-251b0f5a573c req-d658efa2-10f7-4832-b3a9-be4782fa5378 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:32 user nova-compute[76049]: WARNING nova.compute.manager [req-d3069ba7-8ffe-44f4-b020-251b0f5a573c req-d658efa2-10f7-4832-b3a9-be4782fa5378 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received unexpected event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with vm_state building and task_state spawning.
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'flavor' on Instance uuid 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e31e461-ffd7-4dbd-8eb2-818b40cf2fed tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.949s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:22:34 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance spawned successfully.
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-8e78b4a7-1533-433b-afa8-231c3c00cbf2 req-c6c8a243-3f4b-48e9-ac89-aea663e0022a service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e78b4a7-1533-433b-afa8-231c3c00cbf2 req-c6c8a243-3f4b-48e9-ac89-aea663e0022a service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e78b4a7-1533-433b-afa8-231c3c00cbf2 req-c6c8a243-3f4b-48e9-ac89-aea663e0022a service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e78b4a7-1533-433b-afa8-231c3c00cbf2 req-c6c8a243-3f4b-48e9-ac89-aea663e0022a service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-8e78b4a7-1533-433b-afa8-231c3c00cbf2 req-c6c8a243-3f4b-48e9-ac89-aea663e0022a service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:34 user nova-compute[76049]: WARNING nova.compute.manager [req-8e78b4a7-1533-433b-afa8-231c3c00cbf2 req-c6c8a243-3f4b-48e9-ac89-aea663e0022a service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received unexpected event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with vm_state building and task_state spawning.
Nov 15 11:22:34 user nova-compute[76049]: INFO nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:34 user nova-compute[76049]: INFO nova.compute.manager [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Took 7.85 seconds to build instance.
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b4c11560-c811-4e51-9b54-f2d3774f176c tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.967s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquired lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'info_cache' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.objects.base [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:22:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Releasing lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:22:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance destroyed successfully.
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'resources' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.base [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG os_vif [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ba8d621-88, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=633e5b98-c3a0-4ab2-814a-88622dfda952) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:35 user nova-compute[76049]: INFO os_vif [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88')
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Start _get_guest_xml network_info=[{"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'numa_topology' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.base [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:35 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:35 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.base [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'pci_devices' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.objects.base [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:22:35 user nova-compute[76049]:   <uuid>125d7724-a310-49e5-9117-3c6a0527b117</uuid>
Nov 15 11:22:35 user nova-compute[76049]:   <name>instance-00000016</name>
Nov 15 11:22:35 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:22:35 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:22:35 user nova-compute[76049]:   <metadata>
Nov 15 11:22:35 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:22:35 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:22:35 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeTestJSON-server-533537040</nova:name>
Nov 15 11:22:35 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:22:35</nova:creationTime>
Nov 15 11:22:35 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:22:35 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:22:35 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:22:35 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:22:35 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:22:35 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:22:35 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:22:35 user nova-compute[76049]:       <nova:owner>
Nov 15 11:22:35 user nova-compute[76049]:         <nova:user uuid="aab3b8846d7649a78b8f0be07f51945e">tempest-AttachVolumeTestJSON-401613630-project-member</nova:user>
Nov 15 11:22:35 user nova-compute[76049]:         <nova:project uuid="b66e129b2747494fb8fa7cb798b7dc3c">tempest-AttachVolumeTestJSON-401613630</nova:project>
Nov 15 11:22:35 user nova-compute[76049]:       </nova:owner>
Nov 15 11:22:35 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:22:35 user nova-compute[76049]:       <nova:ports>
Nov 15 11:22:35 user nova-compute[76049]:         <nova:port uuid="5ba8d621-889a-4c32-889b-d0cd4adf2472">
Nov 15 11:22:35 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:22:35 user nova-compute[76049]:         </nova:port>
Nov 15 11:22:35 user nova-compute[76049]:       </nova:ports>
Nov 15 11:22:35 user nova-compute[76049]:     </nova:instance>
Nov 15 11:22:35 user nova-compute[76049]:   </metadata>
Nov 15 11:22:35 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:22:35 user nova-compute[76049]:     <system>
Nov 15 11:22:35 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:22:35 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:22:35 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:22:35 user nova-compute[76049]:       <entry name="serial">125d7724-a310-49e5-9117-3c6a0527b117</entry>
Nov 15 11:22:35 user nova-compute[76049]:       <entry name="uuid">125d7724-a310-49e5-9117-3c6a0527b117</entry>
Nov 15 11:22:35 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:22:35 user nova-compute[76049]:     </system>
Nov 15 11:22:35 user nova-compute[76049]:   </sysinfo>
Nov 15 11:22:35 user nova-compute[76049]:   <os>
Nov 15 11:22:35 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:22:35 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:22:35 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:22:35 user nova-compute[76049]:   </os>
Nov 15 11:22:35 user nova-compute[76049]:   <features>
Nov 15 11:22:35 user nova-compute[76049]:     <acpi/>
Nov 15 11:22:35 user nova-compute[76049]:     <apic/>
Nov 15 11:22:35 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:22:35 user nova-compute[76049]:   </features>
Nov 15 11:22:35 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:22:35 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:22:35 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:22:35 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:22:35 user nova-compute[76049]:   </clock>
Nov 15 11:22:35 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:22:35 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:22:35 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:22:35 user nova-compute[76049]:   </cpu>
Nov 15 11:22:35 user nova-compute[76049]:   <devices>
Nov 15 11:22:35 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:22:35 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:22:35 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk"/>
Nov 15 11:22:35 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:22:35 user nova-compute[76049]:     </disk>
Nov 15 11:22:35 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:22:35 user nova-compute[76049]:       <mac address="fa:16:3e:79:34:99"/>
Nov 15 11:22:35 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:22:35 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:22:35 user nova-compute[76049]:       <target dev="tap5ba8d621-88"/>
Nov 15 11:22:35 user nova-compute[76049]:     </interface>
Nov 15 11:22:35 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:22:35 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/console.log" append="off"/>
Nov 15 11:22:35 user nova-compute[76049]:     </serial>
Nov 15 11:22:35 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:22:35 user nova-compute[76049]:     <video>
Nov 15 11:22:35 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:22:35 user nova-compute[76049]:     </video>
Nov 15 11:22:35 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:22:35 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:22:35 user nova-compute[76049]:     </rng>
Nov 15 11:22:35 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:22:35 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:22:35 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:22:35 user nova-compute[76049]:     </memballoon>
Nov 15 11:22:35 user nova-compute[76049]:   </devices>
Nov 15 11:22:35 user nova-compute[76049]: </domain>
Nov 15 11:22:35 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'trusted_certs' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.objects.base [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.210s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Cannot resize image /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'migration_context' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.objects.base [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Object Instance<125d7724-a310-49e5-9117-3c6a0527b117> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG os_vif [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f6d92c5-a809-5a71-8a74-fe514389e03c', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ba8d621-88, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ba8d621-88, col_values=(('qos', UUID('14a47ecf-fb33-4f43-b9ae-00967dca9485')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ba8d621-88, col_values=(('external_ids', {'iface-id': '5ba8d621-889a-4c32-889b-d0cd4adf2472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:34:99', 'vm-uuid': '125d7724-a310-49e5-9117-3c6a0527b117'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:36 user nova-compute[76049]: INFO os_vif [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88')
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-afb733c7-3c8a-4b4d-aee5-fcc19ff655e5 req-8848defd-39a5-49d7-b91f-ed4be31bd392 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-afb733c7-3c8a-4b4d-aee5-fcc19ff655e5 req-8848defd-39a5-49d7-b91f-ed4be31bd392 service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-afb733c7-3c8a-4b4d-aee5-fcc19ff655e5 req-8848defd-39a5-49d7-b91f-ed4be31bd392 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-afb733c7-3c8a-4b4d-aee5-fcc19ff655e5 req-8848defd-39a5-49d7-b91f-ed4be31bd392 service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-afb733c7-3c8a-4b4d-aee5-fcc19ff655e5 req-8848defd-39a5-49d7-b91f-ed4be31bd392 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:40 user nova-compute[76049]: WARNING nova.compute.manager [req-afb733c7-3c8a-4b4d-aee5-fcc19ff655e5 req-8848defd-39a5-49d7-b91f-ed4be31bd392 service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state stopped and task_state powering-on.
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-4f313756-ed1b-40dc-9944-877629071be1 req-9d3e9db3-9a6c-46c3-8e6f-736c16a22c0f service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4f313756-ed1b-40dc-9944-877629071be1 req-9d3e9db3-9a6c-46c3-8e6f-736c16a22c0f service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4f313756-ed1b-40dc-9944-877629071be1 req-9d3e9db3-9a6c-46c3-8e6f-736c16a22c0f service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4f313756-ed1b-40dc-9944-877629071be1 req-9d3e9db3-9a6c-46c3-8e6f-736c16a22c0f service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-4f313756-ed1b-40dc-9944-877629071be1 req-9d3e9db3-9a6c-46c3-8e6f-736c16a22c0f service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:40 user nova-compute[76049]: WARNING nova.compute.manager [req-4f313756-ed1b-40dc-9944-877629071be1 req-9d3e9db3-9a6c-46c3-8e6f-736c16a22c0f service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state stopped and task_state powering-on.
Nov 15 11:22:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=25.082782745361328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:40 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance rebooted successfully.
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d8d1cc67-2ff1-4f10-a496-5ab0735326f5 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 791aeb30-373c-405b-b408-fdba0d4a3cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:22:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:41 user nova-compute[76049]: INFO nova.compute.manager [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attaching volume f7d0dd79-3716-4a3d-b25a-deef94403d84 to /dev/vdb
Nov 15 11:22:41 user nova-compute[76049]: DEBUG os_brick.utils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed399f0f-71d3-42b3-8112-b7895d5efe8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c442ef3-c5cf-4a77-9e77-03058b3e860b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[677ce51d-7491-4627-8025-0f0cbc365ea3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf473c8-182c-4720-8339-f35d81af6b4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:22:41 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:22:41 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[709cc0da-2497-4099-96ea-1f03182c5211]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG os_brick.utils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:41 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating existing volume attachment record: ab322197-a3bf-4916-ace8-ff02612dbdcd {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:22:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:22:46 user nova-compute[76049]: INFO nova.compute.manager [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] instance snapshotting
Nov 15 11:22:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:46 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Beginning live snapshot process
Nov 15 11:22:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqhQrMxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:47 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[220813bc-cec6-4908-bddd-b543564268d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:22:47 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b0765-b8ad-49f6-bab4-93cc61a101c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84] added
Nov 15 11:22:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee4b12-6e1c-4020-8e42-1fc01e8a52a6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f1758f-28f1-449e-af2d-adb56eced8f2]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqhQrMxe {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqhQrMxe" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae6a64-b270-48a5-8dd3-f841939522d3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqhQrMxe'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a417123e-816a-4301-acff-9f048257a809]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aaff44-e4c2-40e2-b248-1a2bb94e04b5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d4fd2e-8797-4c94-96c0-619aefde5991]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260]
Nov 15 11:22:47 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260] successful.
Nov 15 11:22:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d241e5-4743-42ca-a8a6-7b6ef7234180]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d5a3a-b733-4fae-9f98-416af22364e3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)
Nov 15 11:22:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpox7f9jhq/97351250782d466983d7510a4b07f464.delta 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be6da33-a981-4af9-8d62-eb3585e6ee3e]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqhQrMxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:22:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpox7f9jhq/97351250782d466983d7510a4b07f464.delta 1073741824" returned: 0 in 0.058s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 11:22:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:22:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23262383861386636', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262383861386636', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:22:48 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:22:48 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:22:48 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:22:48 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:22:48 user nova-compute[76049]:   <serial>f7d0dd79-3716-4a3d-b25a-deef94403d84</serial>
Nov 15 11:22:48 user nova-compute[76049]: </disk>
Nov 15 11:22:48 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:22:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] COPY block job progress, current cursor: 17170432 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:22:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:22:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:22:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No VIF found with MAC fa:16:3e:d8:c1:d4, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:22:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b0d123bd-5861-4f87-a33c-255bec19d3d1 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.775s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:22:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 11:22:49 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:22:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpox7f9jhq/97351250782d466983d7510a4b07f464.delta /opt/stack/data/nova/instances/snapshots/tmpox7f9jhq/97351250782d466983d7510a4b07f464 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpox7f9jhq/97351250782d466983d7510a4b07f464.delta /opt/stack/data/nova/instances/snapshots/tmpox7f9jhq/97351250782d466983d7510a4b07f464" returned: 0 in 0.596s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:50 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Snapshot extracted, beginning image upload
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "791aeb30-373c-405b-b408-fdba0d4a3cee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:50 user nova-compute[76049]: INFO nova.compute.manager [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Terminating instance
Nov 15 11:22:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-d737f704-389a-41e6-b536-ef25e5b522ac req-74516218-eb6f-4c58-ba26-992f42035c4f service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-vif-unplugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d737f704-389a-41e6-b536-ef25e5b522ac req-74516218-eb6f-4c58-ba26-992f42035c4f service nova] Acquiring lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d737f704-389a-41e6-b536-ef25e5b522ac req-74516218-eb6f-4c58-ba26-992f42035c4f service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d737f704-389a-41e6-b536-ef25e5b522ac req-74516218-eb6f-4c58-ba26-992f42035c4f service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-d737f704-389a-41e6-b536-ef25e5b522ac req-74516218-eb6f-4c58-ba26-992f42035c4f service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] No waiting events found dispatching network-vif-unplugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-d737f704-389a-41e6-b536-ef25e5b522ac req-74516218-eb6f-4c58-ba26-992f42035c4f service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-vif-unplugged-a55c1b89-518e-4352-95c1-a69902fcda3c for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:22:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:51 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Instance destroyed successfully.
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.objects.instance [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'resources' on Instance uuid 791aeb30-373c-405b-b408-fdba0d4a3cee {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1342592007',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1342592007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1342592007',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDYeihAJbgORV6RlPvMoeXiCbkKITOUaL3H8fnfzuJZ/Ahes/BykKbwgKgBiRAbTWHkSwSfEoqpv7zoUkCDRQ7alDPzY5rM9xA+gxjsXz01h2tAt3kZyzfhcOWxXe2FlA==',key_name='tempest-keypair-1461476167',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-i1qohs31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac7d77f50629413bb7b6c9457156af67',uuid=791aeb30-373c-405b-b408-fdba0d4a3cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "a55c1b89-518e-4352-95c1-a69902fcda3c", "address": "fa:16:3e:16:2f:20", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55c1b89-51", "ovs_interfaceid": "a55c1b89-518e-4352-95c1-a69902fcda3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:2f:20,bridge_name='br-int',has_traffic_filtering=True,id=a55c1b89-518e-4352-95c1-a69902fcda3c,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55c1b89-51') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_vif [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:2f:20,bridge_name='br-int',has_traffic_filtering=True,id=a55c1b89-518e-4352-95c1-a69902fcda3c,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55c1b89-51') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa55c1b89-51, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e118dd0-d39a-438a-b2f6-431745f5498f) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:51 user nova-compute[76049]: INFO os_vif [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:2f:20,bridge_name='br-int',has_traffic_filtering=True,id=a55c1b89-518e-4352-95c1-a69902fcda3c,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55c1b89-51')
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZYLEreQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:22:51 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[77285116-1e76-46c0-9322-179517218817]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:22:51 user nova-compute[76049]: No targets found.
Nov 15 11:22:51 user nova-compute[76049]: iSNS:
Nov 15 11:22:51 user nova-compute[76049]: No targets found.
Nov 15 11:22:51 user nova-compute[76049]: STATIC:
Nov 15 11:22:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84
Nov 15 11:22:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:22:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:22:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:22:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10
Nov 15 11:22:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:22:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:22:51 user nova-compute[76049]: FIRMWARE:
Nov 15 11:22:51 user nova-compute[76049]: No targets found.
Nov 15 11:22:51 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:22:51 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:22:51 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce967956-eaba-4a63-9d0e-f1b9dfcedd17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924e2a8-f81f-4c11-bd15-655dc7e3decf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)
Nov 15 11:22:51 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607afa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[638fcb8e-59f9-4103-bed5-42847b429df0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd3977-d6af-4e6a-b38f-4f360ff697bc]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b7fe4-0c99-4547-a79d-e65809370ad1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.090s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cfa9d2-a7f6-4863-9a59-bc028780460e]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_558c3e25', '/dev/disk/by-id/scsi-1SCST_BIO558c3e25-0c0ed7e3091f3151', '/dev/disk/by-id/scsi-23063306564376533') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb123e1-74dc-4942-a066-e325e2421e2b]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ff841-0db7-463e-b8ce-09a7fef66659]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[00378b2d-8723-4f95-a27d-930ce03cbebf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260]
Nov 15 11:22:51 user nova-compute[76049]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10, portal: 172.16.0.220,3260] successful.
Nov 15 11:22:51 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:255a1103-65e5-4bcd-8127-ea2aabbf2b10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c8415-77e2-4396-ae28-14d43e16bedf]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== disconnect_volume: return (388ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:22:51 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Deleting instance files /opt/stack/data/nova/instances/791aeb30-373c-405b-b408-fdba0d4a3cee_del
Nov 15 11:22:51 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Deletion of /opt/stack/data/nova/instances/791aeb30-373c-405b-b408-fdba0d4a3cee_del complete
Nov 15 11:22:51 user nova-compute[76049]: INFO nova.compute.manager [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:51 user nova-compute[76049]: INFO nova.compute.manager [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Detaching volume f7d0dd79-3716-4a3d-b25a-deef94403d84
Nov 15 11:22:51 user nova-compute[76049]: INFO nova.virt.block_device [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attempting to driver detach volume f7d0dd79-3716-4a3d-b25a-deef94403d84 from mountpoint /dev/vdb
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Attempting to detach device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:22:51 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:22:51 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:22:51 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:22:51 user nova-compute[76049]:   <serial>f7d0dd79-3716-4a3d-b25a-deef94403d84</serial>
Nov 15 11:22:51 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:22:51 user nova-compute[76049]: </disk>
Nov 15 11:22:51 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:22:51 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config.
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:22:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:22:51 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:22:51 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:22:51 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:22:51 user nova-compute[76049]:   <serial>f7d0dd79-3716-4a3d-b25a-deef94403d84</serial>
Nov 15 11:22:51 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:22:51 user nova-compute[76049]: </disk>
Nov 15 11:22:51 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-bf5a340c-dbf6-45ad-9d87-ed04de86cbc3 req-0ae34fad-084a-427e-875d-41a0087332cb service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-vif-deleted-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:52 user nova-compute[76049]: INFO nova.compute.manager [req-bf5a340c-dbf6-45ad-9d87-ed04de86cbc3 req-0ae34fad-084a-427e-875d-41a0087332cb service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Neutron deleted interface a55c1b89-518e-4352-95c1-a69902fcda3c; detaching it from the instance and deleting it from the info cache
Nov 15 11:22:52 user nova-compute[76049]: DEBUG nova.network.neutron [req-bf5a340c-dbf6-45ad-9d87-ed04de86cbc3 req-0ae34fad-084a-427e-875d-41a0087332cb service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:22:52 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Took 0.80 seconds to deallocate network for instance.
Nov 15 11:22:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-bf5a340c-dbf6-45ad-9d87-ed04de86cbc3 req-0ae34fad-084a-427e-875d-41a0087332cb service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Detach interface failed, port_id=a55c1b89-518e-4352-95c1-a69902fcda3c, reason: Instance 791aeb30-373c-405b-b408-fdba0d4a3cee could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-6a86d223-dd15-4e69-a546-b6194821ff9c req-f66a2995-65cd-4511-b1f6-f7d26441315c service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received event network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6a86d223-dd15-4e69-a546-b6194821ff9c req-f66a2995-65cd-4511-b1f6-f7d26441315c service nova] Acquiring lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6a86d223-dd15-4e69-a546-b6194821ff9c req-f66a2995-65cd-4511-b1f6-f7d26441315c service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6a86d223-dd15-4e69-a546-b6194821ff9c req-f66a2995-65cd-4511-b1f6-f7d26441315c service nova] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:52 user nova-compute[76049]: DEBUG nova.compute.manager [req-6a86d223-dd15-4e69-a546-b6194821ff9c req-f66a2995-65cd-4511-b1f6-f7d26441315c service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] No waiting events found dispatching network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:22:52 user nova-compute[76049]: WARNING nova.compute.manager [req-6a86d223-dd15-4e69-a546-b6194821ff9c req-f66a2995-65cd-4511-b1f6-f7d26441315c service nova] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Received unexpected event network-vif-plugged-a55c1b89-518e-4352-95c1-a69902fcda3c for instance with vm_state active and task_state deleting.
Nov 15 11:22:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Snapshot image upload complete
Nov 15 11:22:53 user nova-compute[76049]: INFO nova.compute.manager [None req-938db433-b0a6-43f2-920b-ad51bac42c51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Took 6.53 seconds to snapshot the instance on the hypervisor.
Nov 15 11:22:53 user nova-compute[76049]: INFO nova.compute.manager [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Took 0.81 seconds to detach 1 volumes for instance.
Nov 15 11:22:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 791aeb30-373c-405b-b408-fdba0d4a3cee] Deleting volume: 255a1103-65e5-4bcd-8127-ea2aabbf2b10 {{(pid=76049) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 11:22:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:22:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:22:53 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:22:53 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:22:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:53 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Deleted allocations for instance 791aeb30-373c-405b-b408-fdba0d4a3cee
Nov 15 11:22:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-149a7279-9327-4b20-b26a-d0a43d03ef73 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "791aeb30-373c-405b-b408-fdba0d4a3cee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.786s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:22:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:22:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:01 user nova-compute[76049]: INFO nova.compute.manager [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Terminating instance
Nov 15 11:23:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-85b551eb-7bf9-480c-abad-1addd560abf8 req-a6341874-95f2-4b2a-8727-b955569361c8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-unplugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-85b551eb-7bf9-480c-abad-1addd560abf8 req-a6341874-95f2-4b2a-8727-b955569361c8 service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-85b551eb-7bf9-480c-abad-1addd560abf8 req-a6341874-95f2-4b2a-8727-b955569361c8 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-85b551eb-7bf9-480c-abad-1addd560abf8 req-a6341874-95f2-4b2a-8727-b955569361c8 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-85b551eb-7bf9-480c-abad-1addd560abf8 req-a6341874-95f2-4b2a-8727-b955569361c8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-unplugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-85b551eb-7bf9-480c-abad-1addd560abf8 req-a6341874-95f2-4b2a-8727-b955569361c8 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-unplugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Instance destroyed successfully.
Nov 15 11:23:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'resources' on Instance uuid 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T11:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-629386612',display_name='tempest-ServerActionsTestOtherA-server-1932880119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-629386612',id=29,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdfw8Vhn8HmFUxs4uQBERoBTqPeLBl7Un+FuADAkStah/A1RlP/97OuP2PrMkPLvhz7jjAvT72k+haEZtzLpKYwmYQP/3EEIX5nmnAAZc/QHHdaPJIknGNQRE+WnywtGQ==',key_name='tempest-keypair-1985050702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-ovhgk6k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "address": "fa:16:3e:67:a7:79", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106fa0fd-82", "ovs_interfaceid": "106fa0fd-82a1-49f2-a0f8-35cc9c49ec31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG os_vif [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap106fa0fd-82, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0db411f-eee8-4797-a0ae-72f64a4e3f02) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:02 user nova-compute[76049]: INFO os_vif [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:a7:79,bridge_name='br-int',has_traffic_filtering=True,id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106fa0fd-82')
Nov 15 11:23:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Deleting instance files /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa_del
Nov 15 11:23:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Deletion of /opt/stack/data/nova/instances/24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa_del complete
Nov 15 11:23:02 user nova-compute[76049]: INFO nova.compute.manager [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 11:23:02 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:23:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:03 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Took 1.20 seconds to deallocate network for instance.
Nov 15 11:23:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-c57c753e-3a73-4bac-adb0-3d0cd5c40bcf req-eb9e3bb0-2870-4931-8c3e-d4de02f9c168 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-deleted-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:03 user nova-compute[76049]: INFO nova.compute.manager [req-c57c753e-3a73-4bac-adb0-3d0cd5c40bcf req-eb9e3bb0-2870-4931-8c3e-d4de02f9c168 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Neutron deleted interface 106fa0fd-82a1-49f2-a0f8-35cc9c49ec31; detaching it from the instance and deleting it from the info cache
Nov 15 11:23:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-c57c753e-3a73-4bac-adb0-3d0cd5c40bcf req-eb9e3bb0-2870-4931-8c3e-d4de02f9c168 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-c57c753e-3a73-4bac-adb0-3d0cd5c40bcf req-eb9e3bb0-2870-4931-8c3e-d4de02f9c168 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Detach interface failed, port_id=106fa0fd-82a1-49f2-a0f8-35cc9c49ec31, reason: Instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-44b87f0b-bde6-4e57-9a57-edd09c626737 req-a990e6b6-29dd-43c8-aeaa-ab82fb591a19 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-44b87f0b-bde6-4e57-9a57-edd09c626737 req-a990e6b6-29dd-43c8-aeaa-ab82fb591a19 service nova] Acquiring lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-44b87f0b-bde6-4e57-9a57-edd09c626737 req-a990e6b6-29dd-43c8-aeaa-ab82fb591a19 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-44b87f0b-bde6-4e57-9a57-edd09c626737 req-a990e6b6-29dd-43c8-aeaa-ab82fb591a19 service nova] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-44b87f0b-bde6-4e57-9a57-edd09c626737 req-a990e6b6-29dd-43c8-aeaa-ab82fb591a19 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] No waiting events found dispatching network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:23:03 user nova-compute[76049]: WARNING nova.compute.manager [req-44b87f0b-bde6-4e57-9a57-edd09c626737 req-a990e6b6-29dd-43c8-aeaa-ab82fb591a19 service nova] [instance: 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa] Received unexpected event network-vif-plugged-106fa0fd-82a1-49f2-a0f8-35cc9c49ec31 for instance with vm_state deleted and task_state None.
Nov 15 11:23:04 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:23:04 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:23:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.793s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:04 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Deleted allocations for instance 24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa
Nov 15 11:23:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8fc7aa1f-96ff-4c79-8bf6-eea894fb65c0 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "24cc8982-7f8f-4bbe-89fc-1bb2c0ab55fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:05 user nova-compute[76049]: INFO nova.compute.manager [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Detaching volume b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:23:05 user nova-compute[76049]: INFO nova.virt.block_device [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Attempting to driver detach volume b4c58aa4-0b09-4601-96a8-d07607335257 from mountpoint /dev/vdb
Nov 15 11:23:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Attempting to detach device vdb from instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:23:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:23:05 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:23:05 user nova-compute[76049]:   <source dev="/dev/sdf"/>
Nov 15 11:23:05 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:23:05 user nova-compute[76049]:   <serial>b4c58aa4-0b09-4601-96a8-d07607335257</serial>
Nov 15 11:23:05 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:23:05 user nova-compute[76049]: </disk>
Nov 15 11:23:05 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:23:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully detached device vdb from instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d from the persistent domain config.
Nov 15 11:23:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:23:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:23:05 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:23:05 user nova-compute[76049]:   <source dev="/dev/sdf"/>
Nov 15 11:23:05 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:23:05 user nova-compute[76049]:   <serial>b4c58aa4-0b09-4601-96a8-d07607335257</serial>
Nov 15 11:23:05 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:23:05 user nova-compute[76049]: </disk>
Nov 15 11:23:05 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:23:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:23:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 is timed out.
Nov 15 11:23:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config.
Nov 15 11:23:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqhQrMxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:23:12 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0607677-fb96-4671-822c-78725125d57c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:23:12 user nova-compute[76049]: No targets found.
Nov 15 11:23:12 user nova-compute[76049]: iSNS:
Nov 15 11:23:12 user nova-compute[76049]: No targets found.
Nov 15 11:23:12 user nova-compute[76049]: STATIC:
Nov 15 11:23:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84
Nov 15 11:23:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:23:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:23:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:23:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:23:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:23:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:23:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:23:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:23:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:23:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:23:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:23:12 user nova-compute[76049]: FIRMWARE:
Nov 15 11:23:12 user nova-compute[76049]: No targets found.
Nov 15 11:23:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:23:12 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:23:12 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05def9-3240-4305-bf31-2bea13df5373]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7de5fe3-24bd-4803-9a56-b2cd27d828fd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:12 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:23:12 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:12 user nova-compute[76049]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)
Nov 15 11:23:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:12 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:23:12 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:12 user nova-compute[76049]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 (non-flash)
Nov 15 11:23:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62847c76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e4188c-32ef-425c-b36d-c9037b8c5997]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eeea03-84a4-4ef7-a296-c3f53eb85912]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2442b7a7-aaaa-4ccf-9e60-3bb32e5673f6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde22518-7a5a-4942-a7ba-6f2928a77e91]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f698fd-91a0-4dbc-a0cb-278d61d94459]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6479eb9-24e2-473e-b97a-4cbbbe515a9c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260]
Nov 15 11:23:12 user nova-compute[76049]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84, portal: 172.16.0.220,3260] successful.
Nov 15 11:23:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d0dd79-3716-4a3d-b25a-deef94403d84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb089d3-f95a-4e72-ab97-2bc4fd4b950d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== disconnect_volume: return (288ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:13 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cef673d8-3f6f-4c07-87a7-585a30dc71e8 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.761s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "1a79dd73-e1b9-4bc6-9867-068d622936fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:23:17 user nova-compute[76049]: INFO nova.compute.claims [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Claim successful on node user
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:23:17 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:23:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:23:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.policy [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dc5109be9754d0186a5ea21aaf4e505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a7d89bb9543fcb16dd1deeec8e0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:23:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Creating image(s)
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "/opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "/opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk 1073741824" returned: 0 in 0.047s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Successfully created port: af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.221s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Cannot resize image /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Ensure instance console log exists: /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Successfully updated port: af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "refresh_cache-1a79dd73-e1b9-4bc6-9867-068d622936fb" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquired lock "refresh_cache-1a79dd73-e1b9-4bc6-9867-068d622936fb" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received event network-changed-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Refreshing instance network info cache due to event network-changed-af29a7ef-cb8f-47a7-87c1-cb241b3ea151. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] Acquiring lock "refresh_cache-1a79dd73-e1b9-4bc6-9867-068d622936fb" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Updating instance_info_cache with network_info: [{"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Releasing lock "refresh_cache-1a79dd73-e1b9-4bc6-9867-068d622936fb" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Instance network_info: |[{"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] Acquired lock "refresh_cache-1a79dd73-e1b9-4bc6-9867-068d622936fb" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Refreshing network info cache for port af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Start _get_guest_xml network_info=[{"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:23:19 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:23:19 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1113616424',display_name='tempest-VolumesActionsTest-instance-1113616424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1113616424',id=37,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef3a7d89bb9543fcb16dd1deeec8e0a2',ramdisk_id='',reservation_id='r-d2vtqlou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1320407360',owner_user_name='tempest-VolumesActionsTest-1320407360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:23:18Z,user_data=None,user_id='9dc5109be9754d0186a5ea21aaf4e505',uuid=1a79dd73-e1b9-4bc6-9867-068d622936fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Converting VIF {"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1a:c3,bridge_name='br-int',has_traffic_filtering=True,id=af29a7ef-cb8f-47a7-87c1-cb241b3ea151,network=Network(c7916c1e-2c8d-4d21-a1b4-566300ac94f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf29a7ef-cb') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a79dd73-e1b9-4bc6-9867-068d622936fb {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:23:19 user nova-compute[76049]:   <uuid>1a79dd73-e1b9-4bc6-9867-068d622936fb</uuid>
Nov 15 11:23:19 user nova-compute[76049]:   <name>instance-00000025</name>
Nov 15 11:23:19 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:23:19 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:23:19 user nova-compute[76049]:   <metadata>
Nov 15 11:23:19 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:23:19 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:23:19 user nova-compute[76049]:       <nova:name>tempest-VolumesActionsTest-instance-1113616424</nova:name>
Nov 15 11:23:19 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:23:19</nova:creationTime>
Nov 15 11:23:19 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:23:19 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:23:19 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:23:19 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:23:19 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:23:19 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:23:19 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:23:19 user nova-compute[76049]:       <nova:owner>
Nov 15 11:23:19 user nova-compute[76049]:         <nova:user uuid="9dc5109be9754d0186a5ea21aaf4e505">tempest-VolumesActionsTest-1320407360-project-member</nova:user>
Nov 15 11:23:19 user nova-compute[76049]:         <nova:project uuid="ef3a7d89bb9543fcb16dd1deeec8e0a2">tempest-VolumesActionsTest-1320407360</nova:project>
Nov 15 11:23:19 user nova-compute[76049]:       </nova:owner>
Nov 15 11:23:19 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:23:19 user nova-compute[76049]:       <nova:ports>
Nov 15 11:23:19 user nova-compute[76049]:         <nova:port uuid="af29a7ef-cb8f-47a7-87c1-cb241b3ea151">
Nov 15 11:23:19 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:23:19 user nova-compute[76049]:         </nova:port>
Nov 15 11:23:19 user nova-compute[76049]:       </nova:ports>
Nov 15 11:23:19 user nova-compute[76049]:     </nova:instance>
Nov 15 11:23:19 user nova-compute[76049]:   </metadata>
Nov 15 11:23:19 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:23:19 user nova-compute[76049]:     <system>
Nov 15 11:23:19 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:23:19 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:23:19 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:23:19 user nova-compute[76049]:       <entry name="serial">1a79dd73-e1b9-4bc6-9867-068d622936fb</entry>
Nov 15 11:23:19 user nova-compute[76049]:       <entry name="uuid">1a79dd73-e1b9-4bc6-9867-068d622936fb</entry>
Nov 15 11:23:19 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:23:19 user nova-compute[76049]:     </system>
Nov 15 11:23:19 user nova-compute[76049]:   </sysinfo>
Nov 15 11:23:19 user nova-compute[76049]:   <os>
Nov 15 11:23:19 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:23:19 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:23:19 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:23:19 user nova-compute[76049]:   </os>
Nov 15 11:23:19 user nova-compute[76049]:   <features>
Nov 15 11:23:19 user nova-compute[76049]:     <acpi/>
Nov 15 11:23:19 user nova-compute[76049]:     <apic/>
Nov 15 11:23:19 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:23:19 user nova-compute[76049]:   </features>
Nov 15 11:23:19 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:23:19 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:23:19 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:23:19 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:23:19 user nova-compute[76049]:   </clock>
Nov 15 11:23:19 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:23:19 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:23:19 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:23:19 user nova-compute[76049]:   </cpu>
Nov 15 11:23:19 user nova-compute[76049]:   <devices>
Nov 15 11:23:19 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:23:19 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:23:19 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk"/>
Nov 15 11:23:19 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:23:19 user nova-compute[76049]:     </disk>
Nov 15 11:23:19 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:23:19 user nova-compute[76049]:       <mac address="fa:16:3e:c3:1a:c3"/>
Nov 15 11:23:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:23:19 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:23:19 user nova-compute[76049]:       <target dev="tapaf29a7ef-cb"/>
Nov 15 11:23:19 user nova-compute[76049]:     </interface>
Nov 15 11:23:19 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:23:19 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/console.log" append="off"/>
Nov 15 11:23:19 user nova-compute[76049]:     </serial>
Nov 15 11:23:19 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:23:19 user nova-compute[76049]:     <video>
Nov 15 11:23:19 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:23:19 user nova-compute[76049]:     </video>
Nov 15 11:23:19 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:23:19 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:23:19 user nova-compute[76049]:     </rng>
Nov 15 11:23:19 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:23:19 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:23:19 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:23:19 user nova-compute[76049]:     </memballoon>
Nov 15 11:23:19 user nova-compute[76049]:   </devices>
Nov 15 11:23:19 user nova-compute[76049]: </domain>
Nov 15 11:23:19 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1113616424',display_name='tempest-VolumesActionsTest-instance-1113616424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1113616424',id=37,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef3a7d89bb9543fcb16dd1deeec8e0a2',ramdisk_id='',reservation_id='r-d2vtqlou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1320407360',owner_user_name='tempest-VolumesActionsTest-1320407360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:23:18Z,user_data=None,user_id='9dc5109be9754d0186a5ea21aaf4e505',uuid=1a79dd73-e1b9-4bc6-9867-068d622936fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Converting VIF {"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1a:c3,bridge_name='br-int',has_traffic_filtering=True,id=af29a7ef-cb8f-47a7-87c1-cb241b3ea151,network=Network(c7916c1e-2c8d-4d21-a1b4-566300ac94f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf29a7ef-cb') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG os_vif [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1a:c3,bridge_name='br-int',has_traffic_filtering=True,id=af29a7ef-cb8f-47a7-87c1-cb241b3ea151,network=Network(c7916c1e-2c8d-4d21-a1b4-566300ac94f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf29a7ef-cb') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '524c8988-bf6c-5b46-adfa-44bee9420a61', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf29a7ef-cb, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf29a7ef-cb, col_values=(('qos', UUID('359c5766-6017-43be-89ce-171a43f7dad4')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf29a7ef-cb, col_values=(('external_ids', {'iface-id': 'af29a7ef-cb8f-47a7-87c1-cb241b3ea151', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:1a:c3', 'vm-uuid': '1a79dd73-e1b9-4bc6-9867-068d622936fb'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:19 user nova-compute[76049]: INFO os_vif [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1a:c3,bridge_name='br-int',has_traffic_filtering=True,id=af29a7ef-cb8f-47a7-87c1-cb241b3ea151,network=Network(c7916c1e-2c8d-4d21-a1b4-566300ac94f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf29a7ef-cb')
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] No VIF found with MAC fa:16:3e:c3:1a:c3, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Updated VIF entry in instance network info cache for port af29a7ef-cb8f-47a7-87c1-cb241b3ea151. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Updating instance_info_cache with network_info: [{"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e15029a8-39c2-4f7f-b5e3-4ee5fd573ccb req-b909edbb-f737-4b1a-a70b-1d54d2c083d1 service nova] Releasing lock "refresh_cache-1a79dd73-e1b9-4bc6-9867-068d622936fb" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-30bc99c5-70bb-42ca-b504-77723915ab0e req-1e22c598-4bee-4987-80f7-c6e0cb31d595 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received event network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-30bc99c5-70bb-42ca-b504-77723915ab0e req-1e22c598-4bee-4987-80f7-c6e0cb31d595 service nova] Acquiring lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-30bc99c5-70bb-42ca-b504-77723915ab0e req-1e22c598-4bee-4987-80f7-c6e0cb31d595 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-30bc99c5-70bb-42ca-b504-77723915ab0e req-1e22c598-4bee-4987-80f7-c6e0cb31d595 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-30bc99c5-70bb-42ca-b504-77723915ab0e req-1e22c598-4bee-4987-80f7-c6e0cb31d595 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] No waiting events found dispatching network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:23:21 user nova-compute[76049]: WARNING nova.compute.manager [req-30bc99c5-70bb-42ca-b504-77723915ab0e req-1e22c598-4bee-4987-80f7-c6e0cb31d595 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received unexpected event network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 for instance with vm_state building and task_state spawning.
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:23:23 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Instance spawned successfully.
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:23:23 user nova-compute[76049]: INFO nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-e7ea4c18-8b9b-408d-80f9-261c177e1cfc req-cb2978e4-3e87-477d-bb64-eed00fd7f4f5 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received event network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e7ea4c18-8b9b-408d-80f9-261c177e1cfc req-cb2978e4-3e87-477d-bb64-eed00fd7f4f5 service nova] Acquiring lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e7ea4c18-8b9b-408d-80f9-261c177e1cfc req-cb2978e4-3e87-477d-bb64-eed00fd7f4f5 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e7ea4c18-8b9b-408d-80f9-261c177e1cfc req-cb2978e4-3e87-477d-bb64-eed00fd7f4f5 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-e7ea4c18-8b9b-408d-80f9-261c177e1cfc req-cb2978e4-3e87-477d-bb64-eed00fd7f4f5 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] No waiting events found dispatching network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:23:23 user nova-compute[76049]: WARNING nova.compute.manager [req-e7ea4c18-8b9b-408d-80f9-261c177e1cfc req-cb2978e4-3e87-477d-bb64-eed00fd7f4f5 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received unexpected event network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 for instance with vm_state building and task_state spawning.
Nov 15 11:23:23 user nova-compute[76049]: INFO nova.compute.manager [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Took 6.22 seconds to build instance.
Nov 15 11:23:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c9a332a7-dcfe-4c1a-94db-56260d08f50c tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d is timed out.
Nov 15 11:23:25 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully detached device vdb from instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d from the live domain config.
Nov 15 11:23:25 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkhpRiUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:23:25 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c170b1-a234-4939-a6c9-cad7f5ecb85b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:23:25 user nova-compute[76049]: No targets found.
Nov 15 11:23:25 user nova-compute[76049]: iSNS:
Nov 15 11:23:25 user nova-compute[76049]: No targets found.
Nov 15 11:23:25 user nova-compute[76049]: STATIC:
Nov 15 11:23:25 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:23:25 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:23:25 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:23:25 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:23:25 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:23:25 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:23:25 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257
Nov 15 11:23:25 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:23:25 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:23:25 user nova-compute[76049]: FIRMWARE:
Nov 15 11:23:25 user nova-compute[76049]: No targets found.
Nov 15 11:23:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:23:25 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:23:25 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32fca28-65fd-43c8-ac49-bc576ba5c5cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72bb359-26df-4acd-9087-84fa082b2fa0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:25 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:23:25 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:25 user nova-compute[76049]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 (non-flash)
Nov 15 11:23:25 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:25 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629c124940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257'): ({'sdf'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Removing single pathed devices sdf {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9bf87c-1219-4af8-8eec-267e08d4568b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb95e237-8514-4e3b-8620-b4007e58330e]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flushing IO for device /dev/sdf {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec29bb-289a-43c9-96cd-3267fdeccbd0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:23:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa08a5-ad79-4c18-ab88-0350a0555262]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef41f67-7532-4462-b6d4-81731054141b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[73570d1c-4820-42cb-ad4d-6a8b466b3460]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260]
Nov 15 11:23:26 user nova-compute[76049]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257, portal: 172.16.0.220,3260] successful.
Nov 15 11:23:26 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4c58aa4-0b09-4601-96a8-d07607335257 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc6608d-8219-4c5c-bdee-9a688d2bf723]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== disconnect_volume: return (332ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:23:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:23:27 user nova-compute[76049]: DEBUG nova.objects.instance [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-cb26e585-168f-4f1e-8bce-e449ad97c6fd tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:23:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:23:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=25.018848419189453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 125d7724-a310-49e5-9117-3c6a0527b117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1a79dd73-e1b9-4bc6-9867-068d622936fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:23:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG nova.objects.instance [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:44 user nova-compute[76049]: INFO nova.compute.manager [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attaching volume d316acff-eb72-4c12-8250-a64abe4a1e40 to /dev/vdb
Nov 15 11:23:44 user nova-compute[76049]: DEBUG os_brick.utils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c7aac-624d-4d1c-8396-c023e2514b7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560b81f-f7b7-437e-a63a-2f5bc767997b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0138ec99-4e6d-4597-9b4d-2017a68f75b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba318f44-c9bf-4aa2-85c7-5890587a3475]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:23:44 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:23:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa14bc39-5f7c-464d-9013-87d55024fc18]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG os_brick.utils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating existing volume attachment record: 90a7b1d2-b1be-4fe7-a0f0-587138f18fca {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:23:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "733c26a3-786c-42bd-ac1b-684192a359e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "733c26a3-786c-42bd-ac1b-684192a359e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:23:48 user nova-compute[76049]: INFO nova.compute.claims [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Claim successful on node user
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:23:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:23:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG nova.policy [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac7d77f50629413bb7b6c9457156af67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0917737287484e2498e2dcf616b8679e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:23:49 user nova-compute[76049]: INFO nova.virt.block_device [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Booting with volume b22cc816-8326-4fe4-9f15-fb71fcd10852 at /dev/vda
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.utils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9fe53-4bc0-42e1-a3d0-ab95cbe48be9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c1c344-6eb1-40e7-bb92-7f27e50c2b3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c7a3ba-277a-4ca9-aa5d-7ae5d63392d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dea1aa-27ed-4692-9846-a6be3e3d4e8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:23:49 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933e703-df47-4f64-8a4d-fa40be7be13d]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.utils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updating existing volume attachment record: 7c40d96d-1e42-4510-b730-a1b9272cae30 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spWTKvau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:23:49 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:23:49 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:23:49 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d30afe-af5f-4a37-a232-83626aea3e58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:23:49 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd5d381-f524-4030-8c42-e053b3c01e8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40] added
Nov 15 11:23:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[39be3681-c2be-4d42-9634-bf5f0015ca5f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4294ce-0ca5-4319-855f-c90f65624761]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spWTKvau {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spWTKvau" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc94d6d-fabe-4b1f-9cf7-dea93971f00c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'spWTKvau'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b062344-853f-4f4f-940e-5b46c26cf37d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[22385e27-4896-4323-8de2-7330f53aae62]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:49 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:49 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692a781-3ea1-4690-b366-b4612d81172e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260]
Nov 15 11:23:49 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260] successful.
Nov 15 11:23:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f149d9-f2cd-4b5e-aa60-479112e8ce98]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a5849-21fc-47f7-8e6b-00229108ad46]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:49 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:49 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:23:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:49 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:49 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:23:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a473a3-149f-4181-8145-17eddbbd7404]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spWTKvau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Successfully created port: b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:23:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26434346663306330', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434346663306330', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.objects.instance [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Successfully updated port: b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquired lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:23:50 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:23:50 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:23:50 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:23:50 user nova-compute[76049]:   <serial>d316acff-eb72-4c12-8250-a64abe4a1e40</serial>
Nov 15 11:23:50 user nova-compute[76049]: </disk>
Nov 15 11:23:50 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-changed-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.compute.manager [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Refreshing instance network info cache due to event network-changed-b80bc81d-bfad-4781-a6eb-33f8b2780974. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] Acquiring lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:23:50 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updating instance_info_cache with network_info: [{"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Releasing lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Instance network_info: |[{"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] Acquired lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Refreshing network info cache for port b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] No VIF found with MAC fa:16:3e:d8:c1:d4, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4ca051d5-c91e-48fe-be5f-86018c291803 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.087s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updated VIF entry in instance network info cache for port b80bc81d-bfad-4781-a6eb-33f8b2780974. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updating instance_info_cache with network_info: [{"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4c2658bf-d8e0-47c2-9b97-44776c275e15 req-fa5b2af6-0332-4c28-a58c-078ab5863b1f service nova] Releasing lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:23:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:53 user nova-compute[76049]: INFO nova.compute.manager [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Detaching volume d316acff-eb72-4c12-8250-a64abe4a1e40
Nov 15 11:23:53 user nova-compute[76049]: INFO nova.virt.block_device [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Attempting to driver detach volume d316acff-eb72-4c12-8250-a64abe4a1e40 from mountpoint /dev/vdb
Nov 15 11:23:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Attempting to detach device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:23:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:23:53 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:23:53 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:23:53 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:23:53 user nova-compute[76049]:   <serial>d316acff-eb72-4c12-8250-a64abe4a1e40</serial>
Nov 15 11:23:53 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:23:53 user nova-compute[76049]: </disk>
Nov 15 11:23:53 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:23:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the persistent domain config.
Nov 15 11:23:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:23:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:23:53 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:23:53 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:23:53 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:23:53 user nova-compute[76049]:   <serial>d316acff-eb72-4c12-8250-a64abe4a1e40</serial>
Nov 15 11:23:53 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:23:53 user nova-compute[76049]: </disk>
Nov 15 11:23:53 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:23:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:23:54 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Creating image(s)
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Ensure instance console log exists: /opt/stack/data/nova/instances/733c26a3-786c-42bd-ac1b-684192a359e7/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Start _get_guest_xml network_info=[{"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '733c26a3-786c-42bd-ac1b-684192a359e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b22cc816-8326-4fe4-9f15-fb71fcd10852', 'serial': 'b22cc816-8326-4fe4-9f15-fb71fcd10852'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '7c40d96d-1e42-4510-b730-a1b9272cae30', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:23:54 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:23:54 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:23:54 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:23:54 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:23:54 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67aef77-27d1-431b-85d5-71d4074b6506]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:23:54 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ad876-a64a-4a56-9b81-d4da60e215bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852] added
Nov 15 11:23:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dac2a2-d052-473f-9a5c-ba92e225239d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[189dfbf3-b69c-469b-8339-52dac2b30149]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxYZWrjO {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxYZWrjO" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce627c3f-9a08-4430-ac99-83a75adf3000]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxYZWrjO'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[35476b5d-5c41-4fe3-833e-e6f0a7c215e6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c63ff00-a56c-4972-8ee5-398d2c35e355]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3616a455-a798-4851-b120-e1e2b18fb306]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]
Nov 15 11:23:54 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.
Nov 15 11:23:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcb352d-eb50-450f-b0e9-9523c732b725]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e33b4-9cbd-4294-81ea-76742535f1e2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:23:54 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b27e11-3b64-42a3-b1da-74064f8dd5bf]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: None {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:23:55 user nova-compute[76049]: INFO nova.compute.claims [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Claim successful on node user
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.network.neutron [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:23:55 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:55 user nova-compute[76049]: INFO nova.compute.manager [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Terminating instance
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.policy [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bd63b00a9c4f8983e335cf898f77ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a9fe3c211d4bb78b9c6878147a9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:23:55 user nova-compute[76049]: INFO nova.virt.block_device [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Booting with volume-backed-image 2b3c94d7-0d98-4e44-a0fb-491b41156c7f at /dev/vda
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23137623832353035', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137623832353035', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1266316317',display_name='tempest-TestVolumeBootPattern-server-1266316317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1266316317',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-oz5o0y1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:23:49Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=733c26a3-786c-42bd-ac1b-684192a359e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:09:0e,bridge_name='br-int',has_traffic_filtering=True,id=b80bc81d-bfad-4781-a6eb-33f8b2780974,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80bc81d-bf') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'pci_devices' on Instance uuid 733c26a3-786c-42bd-ac1b-684192a359e7 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:23:55 user nova-compute[76049]:   <uuid>733c26a3-786c-42bd-ac1b-684192a359e7</uuid>
Nov 15 11:23:55 user nova-compute[76049]:   <name>instance-00000026</name>
Nov 15 11:23:55 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:23:55 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:23:55 user nova-compute[76049]:   <metadata>
Nov 15 11:23:55 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:23:55 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:23:55 user nova-compute[76049]:       <nova:name>tempest-TestVolumeBootPattern-server-1266316317</nova:name>
Nov 15 11:23:55 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:23:54</nova:creationTime>
Nov 15 11:23:55 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:23:55 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:23:55 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:23:55 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:23:55 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:23:55 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:23:55 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:23:55 user nova-compute[76049]:       <nova:owner>
Nov 15 11:23:55 user nova-compute[76049]:         <nova:user uuid="ac7d77f50629413bb7b6c9457156af67">tempest-TestVolumeBootPattern-2118546811-project-member</nova:user>
Nov 15 11:23:55 user nova-compute[76049]:         <nova:project uuid="0917737287484e2498e2dcf616b8679e">tempest-TestVolumeBootPattern-2118546811</nova:project>
Nov 15 11:23:55 user nova-compute[76049]:       </nova:owner>
Nov 15 11:23:55 user nova-compute[76049]:       <nova:ports>
Nov 15 11:23:55 user nova-compute[76049]:         <nova:port uuid="b80bc81d-bfad-4781-a6eb-33f8b2780974">
Nov 15 11:23:55 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 11:23:55 user nova-compute[76049]:         </nova:port>
Nov 15 11:23:55 user nova-compute[76049]:       </nova:ports>
Nov 15 11:23:55 user nova-compute[76049]:     </nova:instance>
Nov 15 11:23:55 user nova-compute[76049]:   </metadata>
Nov 15 11:23:55 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:23:55 user nova-compute[76049]:     <system>
Nov 15 11:23:55 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:23:55 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:23:55 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:23:55 user nova-compute[76049]:       <entry name="serial">733c26a3-786c-42bd-ac1b-684192a359e7</entry>
Nov 15 11:23:55 user nova-compute[76049]:       <entry name="uuid">733c26a3-786c-42bd-ac1b-684192a359e7</entry>
Nov 15 11:23:55 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:23:55 user nova-compute[76049]:     </system>
Nov 15 11:23:55 user nova-compute[76049]:   </sysinfo>
Nov 15 11:23:55 user nova-compute[76049]:   <os>
Nov 15 11:23:55 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:23:55 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:23:55 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:23:55 user nova-compute[76049]:   </os>
Nov 15 11:23:55 user nova-compute[76049]:   <features>
Nov 15 11:23:55 user nova-compute[76049]:     <acpi/>
Nov 15 11:23:55 user nova-compute[76049]:     <apic/>
Nov 15 11:23:55 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:23:55 user nova-compute[76049]:   </features>
Nov 15 11:23:55 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:23:55 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:23:55 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:23:55 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:23:55 user nova-compute[76049]:   </clock>
Nov 15 11:23:55 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:23:55 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:23:55 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:23:55 user nova-compute[76049]:   </cpu>
Nov 15 11:23:55 user nova-compute[76049]:   <devices>
Nov 15 11:23:55 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:23:55 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:23:55 user nova-compute[76049]:       <source dev="/dev/sde"/>
Nov 15 11:23:55 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:23:55 user nova-compute[76049]:       <serial>b22cc816-8326-4fe4-9f15-fb71fcd10852</serial>
Nov 15 11:23:55 user nova-compute[76049]:     </disk>
Nov 15 11:23:55 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:23:55 user nova-compute[76049]:       <mac address="fa:16:3e:cc:09:0e"/>
Nov 15 11:23:55 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:23:55 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:23:55 user nova-compute[76049]:       <target dev="tapb80bc81d-bf"/>
Nov 15 11:23:55 user nova-compute[76049]:     </interface>
Nov 15 11:23:55 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:23:55 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/733c26a3-786c-42bd-ac1b-684192a359e7/console.log" append="off"/>
Nov 15 11:23:55 user nova-compute[76049]:     </serial>
Nov 15 11:23:55 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:23:55 user nova-compute[76049]:     <video>
Nov 15 11:23:55 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:23:55 user nova-compute[76049]:     </video>
Nov 15 11:23:55 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:23:55 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:23:55 user nova-compute[76049]:     </rng>
Nov 15 11:23:55 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:23:55 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:23:55 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:23:55 user nova-compute[76049]:     </memballoon>
Nov 15 11:23:55 user nova-compute[76049]:   </devices>
Nov 15 11:23:55 user nova-compute[76049]: </domain>
Nov 15 11:23:55 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1266316317',display_name='tempest-TestVolumeBootPattern-server-1266316317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1266316317',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-oz5o0y1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:23:49Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=733c26a3-786c-42bd-ac1b-684192a359e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:09:0e,bridge_name='br-int',has_traffic_filtering=True,id=b80bc81d-bfad-4781-a6eb-33f8b2780974,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80bc81d-bf') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG os_vif [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:09:0e,bridge_name='br-int',has_traffic_filtering=True,id=b80bc81d-bfad-4781-a6eb-33f8b2780974,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80bc81d-bf') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd36b6296-f6a2-543e-95f0-42d80e839377', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb80bc81d-bf, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb80bc81d-bf, col_values=(('qos', UUID('3d599b1d-59e8-402d-9329-695666203ec2')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb80bc81d-bf, col_values=(('external_ids', {'iface-id': 'b80bc81d-bfad-4781-a6eb-33f8b2780974', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:09:0e', 'vm-uuid': '733c26a3-786c-42bd-ac1b-684192a359e7'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:23:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:55 user nova-compute[76049]: INFO os_vif [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:09:0e,bridge_name='br-int',has_traffic_filtering=True,id=b80bc81d-bfad-4781-a6eb-33f8b2780974,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80bc81d-bf')
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-4716af23-9a86-44b1-845a-ce5949874efd req-f895fc95-fb16-476f-bfc6-8a0330904c9a service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-vif-unplugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4716af23-9a86-44b1-845a-ce5949874efd req-f895fc95-fb16-476f-bfc6-8a0330904c9a service nova] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4716af23-9a86-44b1-845a-ce5949874efd req-f895fc95-fb16-476f-bfc6-8a0330904c9a service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4716af23-9a86-44b1-845a-ce5949874efd req-f895fc95-fb16-476f-bfc6-8a0330904c9a service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-4716af23-9a86-44b1-845a-ce5949874efd req-f895fc95-fb16-476f-bfc6-8a0330904c9a service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] No waiting events found dispatching network-vif-unplugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-4716af23-9a86-44b1-845a-ce5949874efd req-f895fc95-fb16-476f-bfc6-8a0330904c9a service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-vif-unplugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No VIF found with MAC fa:16:3e:cc:09:0e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Successfully created port: 8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:23:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Instance destroyed successfully.
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.objects.instance [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'resources' on Instance uuid 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1172032670',display_name='tempest-AttachVolumeNegativeTest-server-1172032670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1172032670',id=31,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAljyrpcQOsZtHgDjq93WiZ/D2yhhEOjU9tNMcdlCC1TbshDBh2SjwTw1GX0kHHRPVzTHpSE/Cm8hmbk87MDBVYMXIe6601wT/+nzWBbo6Fbhu05oePhFYdM7Ov6C/+N4g==',key_name='tempest-keypair-1646149702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-mknt6bc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=64910f05-64cc-4dd7-bfbb-eb7ca622cd7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "address": "fa:16:3e:3e:9b:cd", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2928970-70", "ovs_interfaceid": "f2928970-70be-4f69-bbb4-7dd28dd12a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=f2928970-70be-4f69-bbb4-7dd28dd12a00,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2928970-70') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG os_vif [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=f2928970-70be-4f69-bbb4-7dd28dd12a00,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2928970-70') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2928970-70, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09004343-45e4-43af-89e6-ba208dd13c8a) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:56 user nova-compute[76049]: INFO os_vif [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=f2928970-70be-4f69-bbb4-7dd28dd12a00,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2928970-70')
Nov 15 11:23:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Deleting instance files /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d_del
Nov 15 11:23:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Deletion of /opt/stack/data/nova/instances/64910f05-64cc-4dd7-bfbb-eb7ca622cd7d_del complete
Nov 15 11:23:56 user nova-compute[76049]: INFO nova.compute.manager [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 11:23:56 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:23:56 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Successfully updated port: 8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-changed-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Refreshing instance network info cache due to event network-changed-8a1e98aa-536d-4e05-9833-e8c663128e8c. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] Acquiring lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Updating instance_info_cache with network_info: [{"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance network_info: |[{"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] Acquired lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Refreshing network info cache for port 8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:57 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Took 0.90 seconds to deallocate network for instance.
Nov 15 11:23:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-86d1c590-e399-45db-9e22-466e234cdb00 req-69efb7d3-5d4d-400b-8728-ebd7b447552e service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-86d1c590-e399-45db-9e22-466e234cdb00 req-69efb7d3-5d4d-400b-8728-ebd7b447552e service nova] Acquiring lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-86d1c590-e399-45db-9e22-466e234cdb00 req-69efb7d3-5d4d-400b-8728-ebd7b447552e service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-86d1c590-e399-45db-9e22-466e234cdb00 req-69efb7d3-5d4d-400b-8728-ebd7b447552e service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-86d1c590-e399-45db-9e22-466e234cdb00 req-69efb7d3-5d4d-400b-8728-ebd7b447552e service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] No waiting events found dispatching network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:23:57 user nova-compute[76049]: WARNING nova.compute.manager [req-86d1c590-e399-45db-9e22-466e234cdb00 req-69efb7d3-5d4d-400b-8728-ebd7b447552e service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received unexpected event network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 for instance with vm_state building and task_state spawning.
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Updated VIF entry in instance network info cache for port 8a1e98aa-536d-4e05-9833-e8c663128e8c. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:23:57 user nova-compute[76049]: DEBUG nova.network.neutron [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Updating instance_info_cache with network_info: [{"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81a2c494-02fb-42e1-a278-3c9f8dcae2dd req-4e1a2261-5dcb-43e8-aa63-c9348672b70b service nova] Releasing lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-3368d7a3-13e4-417b-bb3e-108b80d56ced req-191c871b-fc48-4f2e-9a86-70bf39d71b5c service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3368d7a3-13e4-417b-bb3e-108b80d56ced req-191c871b-fc48-4f2e-9a86-70bf39d71b5c service nova] Acquiring lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3368d7a3-13e4-417b-bb3e-108b80d56ced req-191c871b-fc48-4f2e-9a86-70bf39d71b5c service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3368d7a3-13e4-417b-bb3e-108b80d56ced req-191c871b-fc48-4f2e-9a86-70bf39d71b5c service nova] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-3368d7a3-13e4-417b-bb3e-108b80d56ced req-191c871b-fc48-4f2e-9a86-70bf39d71b5c service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] No waiting events found dispatching network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:23:58 user nova-compute[76049]: WARNING nova.compute.manager [req-3368d7a3-13e4-417b-bb3e-108b80d56ced req-191c871b-fc48-4f2e-9a86-70bf39d71b5c service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received unexpected event network-vif-plugged-f2928970-70be-4f69-bbb4-7dd28dd12a00 for instance with vm_state deleted and task_state None.
Nov 15 11:23:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-3368d7a3-13e4-417b-bb3e-108b80d56ced req-191c871b-fc48-4f2e-9a86-70bf39d71b5c service nova] [instance: 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d] Received event network-vif-deleted-f2928970-70be-4f69-bbb4-7dd28dd12a00 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.571s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:58 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Deleted allocations for instance 64910f05-64cc-4dd7-bfbb-eb7ca622cd7d
Nov 15 11:23:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:23:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-451654e1-0ca4-4f91-9874-49377d39d836 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "64910f05-64cc-4dd7-bfbb-eb7ca622cd7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.912s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-6208b753-b317-493a-813c-bb2b22f1b47f req-fef48895-26c4-490f-b9cf-8558d8615eb9 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6208b753-b317-493a-813c-bb2b22f1b47f req-fef48895-26c4-490f-b9cf-8558d8615eb9 service nova] Acquiring lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6208b753-b317-493a-813c-bb2b22f1b47f req-fef48895-26c4-490f-b9cf-8558d8615eb9 service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6208b753-b317-493a-813c-bb2b22f1b47f req-fef48895-26c4-490f-b9cf-8558d8615eb9 service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-6208b753-b317-493a-813c-bb2b22f1b47f req-fef48895-26c4-490f-b9cf-8558d8615eb9 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] No waiting events found dispatching network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:00 user nova-compute[76049]: WARNING nova.compute.manager [req-6208b753-b317-493a-813c-bb2b22f1b47f req-fef48895-26c4-490f-b9cf-8558d8615eb9 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received unexpected event network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 for instance with vm_state building and task_state spawning.
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:24:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Instance spawned successfully.
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:00 user nova-compute[76049]: INFO nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 15 11:24:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:24:00 user nova-compute[76049]: INFO nova.compute.manager [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Took 11.90 seconds to build instance.
Nov 15 11:24:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b59e5b00-740a-4f92-bd8e-ec2c3d6dc7a7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "733c26a3-786c-42bd-ac1b-684192a359e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.012s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG os_brick.utils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20db25-b37c-4c65-a443-ea78d24a1c56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ab084-b6b9-4693-a5a2-e19b0348cd56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa556d6-0a44-4396-945f-17ab70786944]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb68b3f-fb25-42ed-aa1c-c6ec9eb479de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:24:01 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:24:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638b495-cede-41e8-a526-82db0147ef68]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG os_brick.utils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Updating existing volume attachment record: 5907f18b-f96e-4088-bc53-c11ae48cdd42 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:24:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:24:07 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Creating image(s)
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Ensure instance console log exists: /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Start _get_guest_xml network_info=[{"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjkQmdhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7220132d-4ce3-4dfb-b119-4bc6c163fcd8', 'attached_at': '', 'detached_at': '', 'volume_id': '8d426c2c-08bd-4f23-8733-52e4255dda67', 'serial': '8d426c2c-08bd-4f23-8733-52e4255dda67'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5907f18b-f96e-4088-bc53-c11ae48cdd42', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:24:07 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:24:07 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjkQmdhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:24:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:24:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:24:07 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff4444-2341-4770-ac8d-be2c21b54fce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:24:07 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e44c4e-1b2f-43df-82f3-257de4b6cd15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67] added
Nov 15 11:24:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf267989-bce0-4b8b-adf6-1433d8e5567b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20163d-79ff-4168-b0c3-2ccc0c6ad375]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjkQmdhe {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjkQmdhe" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[811848cc-af91-4771-84fc-73c9ec420864]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjkQmdhe'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a5a898-d32c-47ae-b4b5-5bddf7c796a6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[793968e0-4232-43f8-901a-3c836a8c96b5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d7f552-0ca4-4441-8eff-47c99d9b675b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260]
Nov 15 11:24:07 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260] successful.
Nov 15 11:24:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5ae99-d1f6-405f-a166-fc31d52b54dc]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f1993-713d-4fcf-81e9-0fc6ccc6546b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fbb395-05ab-4c12-8031-474f9afeefb3]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:24:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjkQmdhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23537653137343639', 'path': '/dev/sdf'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653137343639', 'path': '/dev/sdf'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911990954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-911990954',id=39,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-7vl5d4pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:23:56Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=7220132d-4ce3-4dfb-b119-4bc6c163fcd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.objects.instance [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'pci_devices' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:24:08 user nova-compute[76049]:   <uuid>7220132d-4ce3-4dfb-b119-4bc6c163fcd8</uuid>
Nov 15 11:24:08 user nova-compute[76049]:   <name>instance-00000027</name>
Nov 15 11:24:08 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:24:08 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:24:08 user nova-compute[76049]:   <metadata>
Nov 15 11:24:08 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:24:08 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:24:08 user nova-compute[76049]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-911990954</nova:name>
Nov 15 11:24:08 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:24:07</nova:creationTime>
Nov 15 11:24:08 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:24:08 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:24:08 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:24:08 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:24:08 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:24:08 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:24:08 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:24:08 user nova-compute[76049]:       <nova:owner>
Nov 15 11:24:08 user nova-compute[76049]:         <nova:user uuid="81bd63b00a9c4f8983e335cf898f77ad">tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member</nova:user>
Nov 15 11:24:08 user nova-compute[76049]:         <nova:project uuid="25a9fe3c211d4bb78b9c6878147a9c75">tempest-ServerBootFromVolumeStableRescueTest-1027868851</nova:project>
Nov 15 11:24:08 user nova-compute[76049]:       </nova:owner>
Nov 15 11:24:08 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:24:08 user nova-compute[76049]:       <nova:ports>
Nov 15 11:24:08 user nova-compute[76049]:         <nova:port uuid="8a1e98aa-536d-4e05-9833-e8c663128e8c">
Nov 15 11:24:08 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 11:24:08 user nova-compute[76049]:         </nova:port>
Nov 15 11:24:08 user nova-compute[76049]:       </nova:ports>
Nov 15 11:24:08 user nova-compute[76049]:     </nova:instance>
Nov 15 11:24:08 user nova-compute[76049]:   </metadata>
Nov 15 11:24:08 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:24:08 user nova-compute[76049]:     <system>
Nov 15 11:24:08 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:24:08 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:24:08 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:24:08 user nova-compute[76049]:       <entry name="serial">7220132d-4ce3-4dfb-b119-4bc6c163fcd8</entry>
Nov 15 11:24:08 user nova-compute[76049]:       <entry name="uuid">7220132d-4ce3-4dfb-b119-4bc6c163fcd8</entry>
Nov 15 11:24:08 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:24:08 user nova-compute[76049]:     </system>
Nov 15 11:24:08 user nova-compute[76049]:   </sysinfo>
Nov 15 11:24:08 user nova-compute[76049]:   <os>
Nov 15 11:24:08 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:24:08 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:24:08 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:24:08 user nova-compute[76049]:   </os>
Nov 15 11:24:08 user nova-compute[76049]:   <features>
Nov 15 11:24:08 user nova-compute[76049]:     <acpi/>
Nov 15 11:24:08 user nova-compute[76049]:     <apic/>
Nov 15 11:24:08 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:24:08 user nova-compute[76049]:   </features>
Nov 15 11:24:08 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:24:08 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:24:08 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:24:08 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:24:08 user nova-compute[76049]:   </clock>
Nov 15 11:24:08 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:24:08 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:24:08 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:24:08 user nova-compute[76049]:   </cpu>
Nov 15 11:24:08 user nova-compute[76049]:   <devices>
Nov 15 11:24:08 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:24:08 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:24:08 user nova-compute[76049]:       <source dev="/dev/sdf"/>
Nov 15 11:24:08 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:24:08 user nova-compute[76049]:       <serial>8d426c2c-08bd-4f23-8733-52e4255dda67</serial>
Nov 15 11:24:08 user nova-compute[76049]:     </disk>
Nov 15 11:24:08 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:24:08 user nova-compute[76049]:       <mac address="fa:16:3e:86:56:10"/>
Nov 15 11:24:08 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:24:08 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:24:08 user nova-compute[76049]:       <target dev="tap8a1e98aa-53"/>
Nov 15 11:24:08 user nova-compute[76049]:     </interface>
Nov 15 11:24:08 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:24:08 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/console.log" append="off"/>
Nov 15 11:24:08 user nova-compute[76049]:     </serial>
Nov 15 11:24:08 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:24:08 user nova-compute[76049]:     <video>
Nov 15 11:24:08 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:24:08 user nova-compute[76049]:     </video>
Nov 15 11:24:08 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:24:08 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:24:08 user nova-compute[76049]:     </rng>
Nov 15 11:24:08 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:24:08 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:24:08 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:24:08 user nova-compute[76049]:     </memballoon>
Nov 15 11:24:08 user nova-compute[76049]:   </devices>
Nov 15 11:24:08 user nova-compute[76049]: </domain>
Nov 15 11:24:08 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911990954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-911990954',id=39,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-7vl5d4pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:23:56Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=7220132d-4ce3-4dfb-b119-4bc6c163fcd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG os_vif [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90680311-bd9a-5bc9-9794-3e638d294dfb', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a1e98aa-53, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a1e98aa-53, col_values=(('qos', UUID('afe832ef-e647-48c3-ab85-88a5597c01d7')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a1e98aa-53, col_values=(('external_ids', {'iface-id': '8a1e98aa-536d-4e05-9833-e8c663128e8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:56:10', 'vm-uuid': '7220132d-4ce3-4dfb-b119-4bc6c163fcd8'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:08 user nova-compute[76049]: INFO os_vif [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53')
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:24:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No VIF found with MAC fa:16:3e:86:56:10, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-415b0c98-f920-4d91-bf2b-c816fb1a1b8f req-7c0d998b-154a-421b-bdd5-386bb2779878 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-415b0c98-f920-4d91-bf2b-c816fb1a1b8f req-7c0d998b-154a-421b-bdd5-386bb2779878 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-415b0c98-f920-4d91-bf2b-c816fb1a1b8f req-7c0d998b-154a-421b-bdd5-386bb2779878 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-415b0c98-f920-4d91-bf2b-c816fb1a1b8f req-7c0d998b-154a-421b-bdd5-386bb2779878 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-415b0c98-f920-4d91-bf2b-c816fb1a1b8f req-7c0d998b-154a-421b-bdd5-386bb2779878 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:10 user nova-compute[76049]: WARNING nova.compute.manager [req-415b0c98-f920-4d91-bf2b-c816fb1a1b8f req-7c0d998b-154a-421b-bdd5-386bb2779878 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state building and task_state spawning.
Nov 15 11:24:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:24:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance spawned successfully.
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-f356b647-f858-46cc-a826-1fcb2c487fc5 req-8d6e5b47-d64d-43d9-8ef5-7bfedb3b7da4 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f356b647-f858-46cc-a826-1fcb2c487fc5 req-8d6e5b47-d64d-43d9-8ef5-7bfedb3b7da4 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f356b647-f858-46cc-a826-1fcb2c487fc5 req-8d6e5b47-d64d-43d9-8ef5-7bfedb3b7da4 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f356b647-f858-46cc-a826-1fcb2c487fc5 req-8d6e5b47-d64d-43d9-8ef5-7bfedb3b7da4 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-f356b647-f858-46cc-a826-1fcb2c487fc5 req-8d6e5b47-d64d-43d9-8ef5-7bfedb3b7da4 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:12 user nova-compute[76049]: WARNING nova.compute.manager [req-f356b647-f858-46cc-a826-1fcb2c487fc5 req-8d6e5b47-d64d-43d9-8ef5-7bfedb3b7da4 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state building and task_state spawning.
Nov 15 11:24:12 user nova-compute[76049]: INFO nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 15 11:24:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:24:12 user nova-compute[76049]: INFO nova.compute.manager [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Took 17.60 seconds to build instance.
Nov 15 11:24:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-79fe8f10-32ed-468a-9015-584d2d0a6ebc tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.718s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:13 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 is timed out.
Nov 15 11:24:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully detached device vdb from instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 from the live domain config.
Nov 15 11:24:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spWTKvau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:24:13 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:24:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4422c3-1a9c-42a8-9b22-719a6a38cf61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:24:13 user nova-compute[76049]: No targets found.
Nov 15 11:24:13 user nova-compute[76049]: iSNS:
Nov 15 11:24:13 user nova-compute[76049]: No targets found.
Nov 15 11:24:13 user nova-compute[76049]: STATIC:
Nov 15 11:24:13 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:24:13 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:24:13 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:24:13 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:24:13 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:24:13 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:24:13 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:24:13 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:24:13 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:24:13 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40
Nov 15 11:24:13 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:24:13 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:24:13 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:24:13 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:24:13 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:24:13 user nova-compute[76049]: FIRMWARE:
Nov 15 11:24:13 user nova-compute[76049]: No targets found.
Nov 15 11:24:13 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:24:13 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:24:13 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4261379b-868a-4781-9cb6-3bf922295cce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc78a91-f391-428b-827a-b3cfc68decb2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f626075b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[170be866-a54a-488f-9ecc-bfd6b12ca996]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[175b6b22-4cad-4645-b8a2-e2cebbbd850c]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab9a859-4c83-4d47-b785-9084f1e0bb2a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bef927-0838-47e8-9cd3-7081a727d6f1]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e92960-3b32-4b51-95c7-a1936db42ec1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b814791-7b59-415b-ab3b-751745c52a20]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260]
Nov 15 11:24:14 user nova-compute[76049]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40, portal: 172.16.0.220,3260] successful.
Nov 15 11:24:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d316acff-eb72-4c12-8250-a64abe4a1e40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8ed0fc-9650-451d-938b-2b7f899fab93]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] <== disconnect_volume: return (316ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:24:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:24:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'flavor' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:24:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-fc702d7c-868c-434c-9e76-b4dbc2e321ac tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.260s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'flavor' on Instance uuid 79b1e190-6f5c-4546-88de-31d8a3ec36b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:19 user nova-compute[76049]: INFO nova.compute.manager [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Attaching volume d01784e2-4351-42b1-8946-c1a352b56b5b to /dev/vdb
Nov 15 11:24:19 user nova-compute[76049]: DEBUG os_brick.utils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbb79dd-33ac-421f-8f40-aee4a15af14a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b064d738-09af-425f-9c74-e4fdcfe05767]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6855d759-09f5-4b7c-ba39-bcb9dcd59ffe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a1686e-348f-4a4c-af1c-8e9c3ebd0b69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:24:19 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:24:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae09c686-69b3-4cd9-a0e0-98db185dfe72]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG os_brick.utils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:24:19 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating existing volume attachment record: f44d987c-b42c-4698-a848-8b5f15d36a79 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:24:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:25 user nova-compute[76049]: INFO nova.compute.manager [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Terminating instance
Nov 15 11:24:25 user nova-compute[76049]: DEBUG nova.compute.manager [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:24:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-c693190f-4e8d-46c5-b66f-bfc39335b4c5 req-7789d69f-9a96-4ef8-bb49-9cd2a712884a service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c693190f-4e8d-46c5-b66f-bfc39335b4c5 req-7789d69f-9a96-4ef8-bb49-9cd2a712884a service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c693190f-4e8d-46c5-b66f-bfc39335b4c5 req-7789d69f-9a96-4ef8-bb49-9cd2a712884a service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c693190f-4e8d-46c5-b66f-bfc39335b4c5 req-7789d69f-9a96-4ef8-bb49-9cd2a712884a service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-c693190f-4e8d-46c5-b66f-bfc39335b4c5 req-7789d69f-9a96-4ef8-bb49-9cd2a712884a service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-c693190f-4e8d-46c5-b66f-bfc39335b4c5 req-7789d69f-9a96-4ef8-bb49-9cd2a712884a service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-unplugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:24:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance destroyed successfully.
Nov 15 11:24:26 user nova-compute[76049]: DEBUG nova.objects.instance [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'resources' on Instance uuid 125d7724-a310-49e5-9117-3c6a0527b117 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-533537040',display_name='tempest-AttachVolumeTestJSON-server-533537040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-533537040',id=22,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPprcoJchieAs8CDBy5dZl24cKKP/Hs1QGq/u6bOz+ieqU6OnaqFSST4rHaUgla6V86L87Rc0fhVy+AHdS1CIgYRucg6hoMLxMOvJwW9YnLNtyIBsdy7vAj1dNU1lMT76A==',key_name='tempest-keypair-934879177',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-931ayqtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=125d7724-a310-49e5-9117-3c6a0527b117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "address": "fa:16:3e:79:34:99", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba8d621-88", "ovs_interfaceid": "5ba8d621-889a-4c32-889b-d0cd4adf2472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG os_vif [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ba8d621-88, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14a47ecf-fb33-4f43-b9ae-00967dca9485) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:26 user nova-compute[76049]: INFO os_vif [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:99,bridge_name='br-int',has_traffic_filtering=True,id=5ba8d621-889a-4c32-889b-d0cd4adf2472,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba8d621-88')
Nov 15 11:24:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Deleting instance files /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117_del
Nov 15 11:24:26 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Deletion of /opt/stack/data/nova/instances/125d7724-a310-49e5-9117-3c6a0527b117_del complete
Nov 15 11:24:27 user nova-compute[76049]: INFO nova.compute.manager [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 11:24:27 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:24:27 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:24:27 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:24:27 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:24:27 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Took 0.72 seconds to deallocate network for instance.
Nov 15 11:24:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:27 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:27 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f18db60-8252-449a-8a09-4d94b8d2d91d req-f720165e-4179-415c-a155-9cac42dc470c service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f18db60-8252-449a-8a09-4d94b8d2d91d req-f720165e-4179-415c-a155-9cac42dc470c service nova] Acquiring lock "125d7724-a310-49e5-9117-3c6a0527b117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f18db60-8252-449a-8a09-4d94b8d2d91d req-f720165e-4179-415c-a155-9cac42dc470c service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9f18db60-8252-449a-8a09-4d94b8d2d91d req-f720165e-4179-415c-a155-9cac42dc470c service nova] Lock "125d7724-a310-49e5-9117-3c6a0527b117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f18db60-8252-449a-8a09-4d94b8d2d91d req-f720165e-4179-415c-a155-9cac42dc470c service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] No waiting events found dispatching network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:28 user nova-compute[76049]: WARNING nova.compute.manager [req-9f18db60-8252-449a-8a09-4d94b8d2d91d req-f720165e-4179-415c-a155-9cac42dc470c service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received unexpected event network-vif-plugged-5ba8d621-889a-4c32-889b-d0cd4adf2472 for instance with vm_state deleted and task_state None.
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-9f18db60-8252-449a-8a09-4d94b8d2d91d req-f720165e-4179-415c-a155-9cac42dc470c service nova] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Received event network-vif-deleted-5ba8d621-889a-4c32-889b-d0cd4adf2472 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.905s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-125d7724-a310-49e5-9117-3c6a0527b117" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 125d7724-a310-49e5-9117-3c6a0527b117] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:28 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Deleted allocations for instance 125d7724-a310-49e5-9117-3c6a0527b117
Nov 15 11:24:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-96a725b9-290d-4a6c-82ba-6eecd27c3e58 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "125d7724-a310-49e5-9117-3c6a0527b117" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xphDuXbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:24:29 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:24:29 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:24:29 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b0a090-a19c-40f3-b23a-24339f60420a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:24:29 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[98972c76-a544-49b4-81b3-e39ab18cf01c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b] added
Nov 15 11:24:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7d1156-099e-4bd3-9324-9bee345addb4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c55890-cade-45bc-8a97-b92f54c2564a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xphDuXbe {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xphDuXbe" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9eb6cc-2c8c-4704-ae13-3e14a6d5dbe8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xphDuXbe'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[473f2d56-6266-4597-bd95-cb7590b0fe61]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddaeb2-5816-4522-ba04-4be105609ae4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d575c5-e3f1-4372-b447-57e13912d38f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260]
Nov 15 11:24:29 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260] successful.
Nov 15 11:24:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c191a41f-5905-4f83-a373-640c76afe0f9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f2d7d0-794e-4f54-bfb7-1d5ee1724b33]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:24:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:24:29 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:24:29 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd121548-67f9-4255-9c5a-55580a243a3b]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:24:29 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xphDuXbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:24:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:24:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23563336462613863', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:24:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563336462613863', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:24:30 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'flavor' on Instance uuid 79b1e190-6f5c-4546-88de-31d8a3ec36b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:24:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:24:30 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:24:30 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:24:30 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:24:30 user nova-compute[76049]:   <serial>d01784e2-4351-42b1-8946-c1a352b56b5b</serial>
Nov 15 11:24:30 user nova-compute[76049]: </disk>
Nov 15 11:24:30 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:24:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:24:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:24:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] No VIF found with MAC fa:16:3e:39:b7:82, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:24:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9813c71f-bcb2-4ea2-98bb-a6d89303d4f4 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.178s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing instance network info cache due to event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] Acquiring lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] Acquired lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG nova.network.neutron [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG nova.network.neutron [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updated VIF entry in instance network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG nova.network.neutron [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-658f896c-8bdd-4852-b9cf-ab4175d981ca req-a0125db0-440b-483f-acd6-cdfce203314f service nova] Releasing lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:24:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing instance network info cache due to event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] Acquiring lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] Acquired lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG nova.network.neutron [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:24:37 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:24:37 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:24:37 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7495MB free_disk=25.01679229736328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:37 user nova-compute[76049]: INFO nova.compute.manager [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Rebooting instance
Nov 15 11:24:37 user nova-compute[76049]: DEBUG nova.network.neutron [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updated VIF entry in instance network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG nova.network.neutron [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebabac9f-8cf5-4b2d-9558-350972bf2107 req-0cf8789c-bf41-44d2-b5e5-1c82defb2dd5 service nova] Releasing lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquired lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:24:37 user nova-compute[76049]: DEBUG nova.network.neutron [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 4640743d-7ecc-4dd8-b892-1135a3add8a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6625217c-b0a0-48c1-972c-f460acd20013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1a79dd73-e1b9-4bc6-9867-068d622936fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 733c26a3-786c-42bd-ac1b-684192a359e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Releasing lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:24:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:24:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-028ba6a8-9678-4b51-af1e-4cc8684b6a13 req-141c557e-4a9b-4d91-9940-bd9babd28965 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-unplugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-028ba6a8-9678-4b51-af1e-4cc8684b6a13 req-141c557e-4a9b-4d91-9940-bd9babd28965 service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-028ba6a8-9678-4b51-af1e-4cc8684b6a13 req-141c557e-4a9b-4d91-9940-bd9babd28965 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-028ba6a8-9678-4b51-af1e-4cc8684b6a13 req-141c557e-4a9b-4d91-9940-bd9babd28965 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-028ba6a8-9678-4b51-af1e-4cc8684b6a13 req-141c557e-4a9b-4d91-9940-bd9babd28965 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-unplugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:41 user nova-compute[76049]: WARNING nova.compute.manager [req-028ba6a8-9678-4b51-af1e-4cc8684b6a13 req-141c557e-4a9b-4d91-9940-bd9babd28965 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received unexpected event network-vif-unplugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with vm_state active and task_state reboot_started.
Nov 15 11:24:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance shutdown successfully.
Nov 15 11:24:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:43 user nova-compute[76049]: WARNING nova.compute.manager [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received unexpected event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with vm_state active and task_state reboot_started.
Nov 15 11:24:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:43 user nova-compute[76049]: WARNING nova.compute.manager [req-ebd05b8a-d3dc-486e-a84a-66901383aa2a req-2e200561-2fce-41dd-82e0-90b64cfde1be service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received unexpected event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with vm_state active and task_state reboot_started.
Nov 15 11:24:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:45 user nova-compute[76049]: DEBUG nova.compute.manager [req-11311c5d-d505-413a-9531-1415b6d6becc req-abfc8305-3b9c-4597-bae0-2728d8325929 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-11311c5d-d505-413a-9531-1415b6d6becc req-abfc8305-3b9c-4597-bae0-2728d8325929 service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-11311c5d-d505-413a-9531-1415b6d6becc req-abfc8305-3b9c-4597-bae0-2728d8325929 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-11311c5d-d505-413a-9531-1415b6d6becc req-abfc8305-3b9c-4597-bae0-2728d8325929 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:45 user nova-compute[76049]: DEBUG nova.compute.manager [req-11311c5d-d505-413a-9531-1415b6d6becc req-abfc8305-3b9c-4597-bae0-2728d8325929 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:45 user nova-compute[76049]: WARNING nova.compute.manager [req-11311c5d-d505-413a-9531-1415b6d6becc req-abfc8305-3b9c-4597-bae0-2728d8325929 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received unexpected event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with vm_state active and task_state reboot_started.
Nov 15 11:24:45 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance running successfully.
Nov 15 11:24:45 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance soft rebooted successfully.
Nov 15 11:24:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:24:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-988fbab1-77d5-421f-8cd1-d0365a06b583 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.617s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:24:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:24:49 user nova-compute[76049]: INFO nova.compute.claims [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Claim successful on node user
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:24:50 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.policy [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3405f82948e641e685ecccb007c4c60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d20305cc32b4da29ebe034a326e401e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:24:50 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Creating image(s)
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk 1073741824" returned: 0 in 0.064s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.205s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Successfully created port: cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Cannot resize image /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Ensure instance console log exists: /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Successfully updated port: cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquired lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-changed-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Refreshing instance network info cache due to event network-changed-cd95e33b-3cbe-45e4-888d-4d7c476fe725. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] Acquiring lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:24:51 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Updating instance_info_cache with network_info: [{"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Releasing lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Instance network_info: |[{"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] Acquired lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.neutron [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Refreshing network info cache for port cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Start _get_guest_xml network_info=[{"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:24:52 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:24:52 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-569980044',display_name='tempest-AttachVolumeNegativeTest-server-569980044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-569980044',id=40,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhjWn/wcFK82/VlkysFKScmO19uQwQZQStQc+DrzfPlmhxQan4J04aqoqRhL3HgalU7fjSwDI1t3PVBUGNeXe0jROaOu7wZ5au6oo2ScMyGdUDqT8n8B323F42Ey9gxVw==',key_name='tempest-keypair-83178527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-zwa059l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=6c9ce91d-18c5-478a-83ae-2f9b374c1416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:fa,bridge_name='br-int',has_traffic_filtering=True,id=cd95e33b-3cbe-45e4-888d-4d7c476fe725,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd95e33b-3c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c9ce91d-18c5-478a-83ae-2f9b374c1416 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:24:52 user nova-compute[76049]:   <uuid>6c9ce91d-18c5-478a-83ae-2f9b374c1416</uuid>
Nov 15 11:24:52 user nova-compute[76049]:   <name>instance-00000028</name>
Nov 15 11:24:52 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:24:52 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:24:52 user nova-compute[76049]:   <metadata>
Nov 15 11:24:52 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:24:52 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:24:52 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeNegativeTest-server-569980044</nova:name>
Nov 15 11:24:52 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:24:52</nova:creationTime>
Nov 15 11:24:52 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:24:52 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:24:52 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:24:52 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:24:52 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:24:52 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:24:52 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:24:52 user nova-compute[76049]:       <nova:owner>
Nov 15 11:24:52 user nova-compute[76049]:         <nova:user uuid="3405f82948e641e685ecccb007c4c60d">tempest-AttachVolumeNegativeTest-2136408759-project-member</nova:user>
Nov 15 11:24:52 user nova-compute[76049]:         <nova:project uuid="2d20305cc32b4da29ebe034a326e401e">tempest-AttachVolumeNegativeTest-2136408759</nova:project>
Nov 15 11:24:52 user nova-compute[76049]:       </nova:owner>
Nov 15 11:24:52 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:24:52 user nova-compute[76049]:       <nova:ports>
Nov 15 11:24:52 user nova-compute[76049]:         <nova:port uuid="cd95e33b-3cbe-45e4-888d-4d7c476fe725">
Nov 15 11:24:52 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 11:24:52 user nova-compute[76049]:         </nova:port>
Nov 15 11:24:52 user nova-compute[76049]:       </nova:ports>
Nov 15 11:24:52 user nova-compute[76049]:     </nova:instance>
Nov 15 11:24:52 user nova-compute[76049]:   </metadata>
Nov 15 11:24:52 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:24:52 user nova-compute[76049]:     <system>
Nov 15 11:24:52 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:24:52 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:24:52 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:24:52 user nova-compute[76049]:       <entry name="serial">6c9ce91d-18c5-478a-83ae-2f9b374c1416</entry>
Nov 15 11:24:52 user nova-compute[76049]:       <entry name="uuid">6c9ce91d-18c5-478a-83ae-2f9b374c1416</entry>
Nov 15 11:24:52 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:24:52 user nova-compute[76049]:     </system>
Nov 15 11:24:52 user nova-compute[76049]:   </sysinfo>
Nov 15 11:24:52 user nova-compute[76049]:   <os>
Nov 15 11:24:52 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:24:52 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:24:52 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:24:52 user nova-compute[76049]:   </os>
Nov 15 11:24:52 user nova-compute[76049]:   <features>
Nov 15 11:24:52 user nova-compute[76049]:     <acpi/>
Nov 15 11:24:52 user nova-compute[76049]:     <apic/>
Nov 15 11:24:52 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:24:52 user nova-compute[76049]:   </features>
Nov 15 11:24:52 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:24:52 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:24:52 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:24:52 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:24:52 user nova-compute[76049]:   </clock>
Nov 15 11:24:52 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:24:52 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:24:52 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:24:52 user nova-compute[76049]:   </cpu>
Nov 15 11:24:52 user nova-compute[76049]:   <devices>
Nov 15 11:24:52 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:24:52 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:24:52 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk"/>
Nov 15 11:24:52 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:24:52 user nova-compute[76049]:     </disk>
Nov 15 11:24:52 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:24:52 user nova-compute[76049]:       <mac address="fa:16:3e:67:6d:fa"/>
Nov 15 11:24:52 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:24:52 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:24:52 user nova-compute[76049]:       <target dev="tapcd95e33b-3c"/>
Nov 15 11:24:52 user nova-compute[76049]:     </interface>
Nov 15 11:24:52 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:24:52 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/console.log" append="off"/>
Nov 15 11:24:52 user nova-compute[76049]:     </serial>
Nov 15 11:24:52 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:24:52 user nova-compute[76049]:     <video>
Nov 15 11:24:52 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:24:52 user nova-compute[76049]:     </video>
Nov 15 11:24:52 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:24:52 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:24:52 user nova-compute[76049]:     </rng>
Nov 15 11:24:52 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:24:52 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:24:52 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:24:52 user nova-compute[76049]:     </memballoon>
Nov 15 11:24:52 user nova-compute[76049]:   </devices>
Nov 15 11:24:52 user nova-compute[76049]: </domain>
Nov 15 11:24:52 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-569980044',display_name='tempest-AttachVolumeNegativeTest-server-569980044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-569980044',id=40,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhjWn/wcFK82/VlkysFKScmO19uQwQZQStQc+DrzfPlmhxQan4J04aqoqRhL3HgalU7fjSwDI1t3PVBUGNeXe0jROaOu7wZ5au6oo2ScMyGdUDqT8n8B323F42Ey9gxVw==',key_name='tempest-keypair-83178527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-zwa059l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=6c9ce91d-18c5-478a-83ae-2f9b374c1416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:fa,bridge_name='br-int',has_traffic_filtering=True,id=cd95e33b-3cbe-45e4-888d-4d7c476fe725,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd95e33b-3c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG os_vif [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:fa,bridge_name='br-int',has_traffic_filtering=True,id=cd95e33b-3cbe-45e4-888d-4d7c476fe725,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd95e33b-3c') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '731e853a-cccd-5bd6-a133-d74b5a6cfe95', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd95e33b-3c, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd95e33b-3c, col_values=(('qos', UUID('10a48b33-a52a-4a6f-9e33-58f3e5f3201f')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd95e33b-3c, col_values=(('external_ids', {'iface-id': 'cd95e33b-3cbe-45e4-888d-4d7c476fe725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:6d:fa', 'vm-uuid': '6c9ce91d-18c5-478a-83ae-2f9b374c1416'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:52 user nova-compute[76049]: INFO os_vif [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:fa,bridge_name='br-int',has_traffic_filtering=True,id=cd95e33b-3cbe-45e4-888d-4d7c476fe725,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd95e33b-3c')
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No VIF found with MAC fa:16:3e:67:6d:fa, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.neutron [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Updated VIF entry in instance network info cache for port cd95e33b-3cbe-45e4-888d-4d7c476fe725. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG nova.network.neutron [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Updating instance_info_cache with network_info: [{"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:24:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-96cf1524-277e-4d42-ab5f-9a74486324ac req-6695c56a-7885-4a04-8f8d-1132f91701d6 service nova] Releasing lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:24:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-b94688dc-12fa-4bc0-b919-02f95a6036cb req-c51d44e7-104a-4110-a2a0-ee698bc0be4f service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b94688dc-12fa-4bc0-b919-02f95a6036cb req-c51d44e7-104a-4110-a2a0-ee698bc0be4f service nova] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b94688dc-12fa-4bc0-b919-02f95a6036cb req-c51d44e7-104a-4110-a2a0-ee698bc0be4f service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b94688dc-12fa-4bc0-b919-02f95a6036cb req-c51d44e7-104a-4110-a2a0-ee698bc0be4f service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG nova.compute.manager [req-b94688dc-12fa-4bc0-b919-02f95a6036cb req-c51d44e7-104a-4110-a2a0-ee698bc0be4f service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] No waiting events found dispatching network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:54 user nova-compute[76049]: WARNING nova.compute.manager [req-b94688dc-12fa-4bc0-b919-02f95a6036cb req-c51d44e7-104a-4110-a2a0-ee698bc0be4f service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received unexpected event network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 for instance with vm_state building and task_state spawning.
Nov 15 11:24:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:24:56 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Instance spawned successfully.
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-ab6b5950-8133-4881-bdd8-7db8bfa4a320 req-c26ea2a0-bf59-4dca-9d01-888dd2c125db service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ab6b5950-8133-4881-bdd8-7db8bfa4a320 req-c26ea2a0-bf59-4dca-9d01-888dd2c125db service nova] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ab6b5950-8133-4881-bdd8-7db8bfa4a320 req-c26ea2a0-bf59-4dca-9d01-888dd2c125db service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ab6b5950-8133-4881-bdd8-7db8bfa4a320 req-c26ea2a0-bf59-4dca-9d01-888dd2c125db service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.compute.manager [req-ab6b5950-8133-4881-bdd8-7db8bfa4a320 req-c26ea2a0-bf59-4dca-9d01-888dd2c125db service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] No waiting events found dispatching network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:24:56 user nova-compute[76049]: WARNING nova.compute.manager [req-ab6b5950-8133-4881-bdd8-7db8bfa4a320 req-c26ea2a0-bf59-4dca-9d01-888dd2c125db service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received unexpected event network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 for instance with vm_state building and task_state spawning.
Nov 15 11:24:56 user nova-compute[76049]: INFO nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 15 11:24:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:24:56 user nova-compute[76049]: INFO nova.compute.manager [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Took 6.86 seconds to build instance.
Nov 15 11:24:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ffc3b2f7-5b29-4000-b333-7ab1fa934eeb tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.984s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:24:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:24:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:25:00 user nova-compute[76049]: INFO nova.compute.claims [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Claim successful on node user
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:25:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:25:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG nova.policy [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c548eac583644342a905b89ee8fc4b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61718ae918a495eadf79664d2ea66c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:25:01 user nova-compute[76049]: INFO nova.virt.block_device [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Booting with volume c64321a7-fb06-4edb-ab36-3478e8c76d7c at /dev/vda
Nov 15 11:25:01 user nova-compute[76049]: DEBUG os_brick.utils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[769fe3b3-6280-4828-968b-23ee38f2a3d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[be155657-f254-4165-b81c-c65c3eb1c30a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38e48d-27cb-42b0-a80d-ba0187905c4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0782ca35-2c40-4f54-8c4c-ba8ab3f80234]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:25:01 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:25:01 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beefde1-eea1-4f11-aafe-2d1acc2eaa1e]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG os_brick.utils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:25:01 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating existing volume attachment record: b6e4a049-14a4-474e-b476-05c5f0dc12c9 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Successfully created port: 3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Successfully updated port: 3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquired lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-changed-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Refreshing instance network info cache due to event network-changed-3f38a8ea-3588-47c3-a10d-7f4787fe629d. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:25:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] Acquiring lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating instance_info_cache with network_info: [{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Releasing lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance network_info: |[{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] Acquired lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Refreshing network info cache for port 3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updated VIF entry in instance network info cache for port 3f38a8ea-3588-47c3-a10d-7f4787fe629d. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating instance_info_cache with network_info: [{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-57500e8c-3612-4a29-b658-d06a9dcd2914 req-c0397065-20c0-4ef6-91d6-f25b63263b4f service nova] Releasing lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:25:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:04 user nova-compute[76049]: INFO nova.compute.manager [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Terminating instance
Nov 15 11:25:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:25:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-472c0077-0276-498a-a138-d07cfcc9c8f5 req-06dcdd70-5fb5-4ec2-a54a-0d409ce9e8ac service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-vif-unplugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-472c0077-0276-498a-a138-d07cfcc9c8f5 req-06dcdd70-5fb5-4ec2-a54a-0d409ce9e8ac service nova] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-472c0077-0276-498a-a138-d07cfcc9c8f5 req-06dcdd70-5fb5-4ec2-a54a-0d409ce9e8ac service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-472c0077-0276-498a-a138-d07cfcc9c8f5 req-06dcdd70-5fb5-4ec2-a54a-0d409ce9e8ac service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-472c0077-0276-498a-a138-d07cfcc9c8f5 req-06dcdd70-5fb5-4ec2-a54a-0d409ce9e8ac service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] No waiting events found dispatching network-vif-unplugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-472c0077-0276-498a-a138-d07cfcc9c8f5 req-06dcdd70-5fb5-4ec2-a54a-0d409ce9e8ac service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-vif-unplugged-56fdea95-142b-46f5-9040-eb62a67c9fdc for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Instance destroyed successfully.
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lazy-loading 'resources' on Instance uuid 4640743d-7ecc-4dd8-b892-1135a3add8a1 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1563173912',display_name='tempest-SnapshotDataIntegrityTests-server-1563173912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1563173912',id=32,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6rAVgalO7+g87UMMruvnA9gZH81tSEjBKFUM7OUa0iZMZRpX8xkWg38eS5oW1NB2MHv7EFZJvknJ0S2c9Rbx6+3rkAKl6KX2tpdn80stT+fZuqUHpJGdQlUWhS6JCK2g==',key_name='tempest-keypair-282384105',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:18:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe816645ab1945a38fb163eb899898b2',ramdisk_id='',reservation_id='r-90pxvz8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-334074251',owner_user_name='tempest-SnapshotDataIntegrityTests-334074251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ff0ce1406b45b7b132cc46a0a03ce8',uuid=4640743d-7ecc-4dd8-b892-1135a3add8a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Converting VIF {"id": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "address": "fa:16:3e:d8:c1:d4", "network": {"id": "737fa543-dc08-4caf-8ac7-9c9fb3456d09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1989072072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe816645ab1945a38fb163eb899898b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fdea95-14", "ovs_interfaceid": "56fdea95-142b-46f5-9040-eb62a67c9fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=56fdea95-142b-46f5-9040-eb62a67c9fdc,network=Network(737fa543-dc08-4caf-8ac7-9c9fb3456d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fdea95-14') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG os_vif [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=56fdea95-142b-46f5-9040-eb62a67c9fdc,network=Network(737fa543-dc08-4caf-8ac7-9c9fb3456d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fdea95-14') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56fdea95-14, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8119e0b-4fe3-45c5-9eee-92320ac39788) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:05 user nova-compute[76049]: INFO os_vif [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=56fdea95-142b-46f5-9040-eb62a67c9fdc,network=Network(737fa543-dc08-4caf-8ac7-9c9fb3456d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fdea95-14')
Nov 15 11:25:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Deleting instance files /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1_del
Nov 15 11:25:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Deletion of /opt/stack/data/nova/instances/4640743d-7ecc-4dd8-b892-1135a3add8a1_del complete
Nov 15 11:25:05 user nova-compute[76049]: INFO nova.compute.manager [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 11:25:05 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:25:05 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:06 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Took 0.61 seconds to deallocate network for instance.
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:25:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Creating image(s)
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Ensure instance console log exists: /opt/stack/data/nova/instances/6426e887-3097-4c19-9340-cd1a76131216/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Start _get_guest_xml network_info=[{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6426e887-3097-4c19-9340-cd1a76131216', 'attached_at': '', 'detached_at': '', 'volume_id': 'c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'serial': 'c64321a7-fb06-4edb-ab36-3478e8c76d7c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'b6e4a049-14a4-474e-b476-05c5f0dc12c9', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:25:06 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:06 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:25:06 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:25:06 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:25:06 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb929d1-7eea-4d8a-91bc-c45f3d1236a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:25:06 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7c5c5b-f0ad-4f00-b7a7-8c935137cbba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c] added
Nov 15 11:25:06 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c8e12-c7f6-4386-9f01-afadada1f131]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e99595e-90b4-4890-bc7c-195b917ffd00]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVyTKng {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:06 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVyTKng" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b709d4-36ba-49c2-ad9b-174ad74c1b74]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZVyTKng'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[837fbd5d-8603-4bb1-8a70-bc9d4854598b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:07 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Deleted allocations for instance 4640743d-7ecc-4dd8-b892-1135a3add8a1
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e235f-3017-4e3b-9f1d-3541e47a7b30]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6012777a-91d7-4b5a-a1aa-376c336072d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]
Nov 15 11:25:07 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.
Nov 15 11:25:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71c7648d-46b8-4a4b-b6f2-99dc88824394 tempest-SnapshotDataIntegrityTests-334074251 tempest-SnapshotDataIntegrityTests-334074251-project-member] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0816f4d7-73a5-487e-8a1c-523e6d2813e3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fecdc2-16aa-4a36-aa28-d449feea8058]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:07 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] HCTL ('38', '-', '-', 0) found on session 52 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7ed42-5218-4428-be27-b10f271be8f1]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching for a device in session 52 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-dac0b194-52f2-4af9-884e-03f6b675e55b req-2a1fa6fa-7995-437a-a9aa-3d8a8abf9a9d service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dac0b194-52f2-4af9-884e-03f6b675e55b req-2a1fa6fa-7995-437a-a9aa-3d8a8abf9a9d service nova] Acquiring lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dac0b194-52f2-4af9-884e-03f6b675e55b req-2a1fa6fa-7995-437a-a9aa-3d8a8abf9a9d service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dac0b194-52f2-4af9-884e-03f6b675e55b req-2a1fa6fa-7995-437a-a9aa-3d8a8abf9a9d service nova] Lock "4640743d-7ecc-4dd8-b892-1135a3add8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-dac0b194-52f2-4af9-884e-03f6b675e55b req-2a1fa6fa-7995-437a-a9aa-3d8a8abf9a9d service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] No waiting events found dispatching network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:07 user nova-compute[76049]: WARNING nova.compute.manager [req-dac0b194-52f2-4af9-884e-03f6b675e55b req-2a1fa6fa-7995-437a-a9aa-3d8a8abf9a9d service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received unexpected event network-vif-plugged-56fdea95-142b-46f5-9040-eb62a67c9fdc for instance with vm_state deleted and task_state None.
Nov 15 11:25:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-dac0b194-52f2-4af9-884e-03f6b675e55b req-2a1fa6fa-7995-437a-a9aa-3d8a8abf9a9d service nova] [instance: 4640743d-7ecc-4dd8-b892-1135a3add8a1] Received event network-vif-deleted-56fdea95-142b-46f5-9040-eb62a67c9fdc {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:07 user nova-compute[76049]: INFO nova.compute.manager [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Terminating instance
Nov 15 11:25:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23734333035656661', 'path': '/dev/sdg'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734333035656661', 'path': '/dev/sdg'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1578483471',display_name='tempest-ServerActionsTestOtherA-server-1578483471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1578483471',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-mjy54lb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=6426e887-3097-4c19-9340-cd1a76131216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.objects.instance [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'pci_devices' on Instance uuid 6426e887-3097-4c19-9340-cd1a76131216 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:25:08 user nova-compute[76049]:   <uuid>6426e887-3097-4c19-9340-cd1a76131216</uuid>
Nov 15 11:25:08 user nova-compute[76049]:   <name>instance-00000029</name>
Nov 15 11:25:08 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:25:08 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:25:08 user nova-compute[76049]:   <metadata>
Nov 15 11:25:08 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:25:08 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:25:08 user nova-compute[76049]:       <nova:name>tempest-ServerActionsTestOtherA-server-1578483471</nova:name>
Nov 15 11:25:08 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:25:06</nova:creationTime>
Nov 15 11:25:08 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:25:08 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:25:08 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:25:08 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:25:08 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:25:08 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:25:08 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:25:08 user nova-compute[76049]:       <nova:owner>
Nov 15 11:25:08 user nova-compute[76049]:         <nova:user uuid="c548eac583644342a905b89ee8fc4b1a">tempest-ServerActionsTestOtherA-278593450-project-member</nova:user>
Nov 15 11:25:08 user nova-compute[76049]:         <nova:project uuid="a61718ae918a495eadf79664d2ea66c6">tempest-ServerActionsTestOtherA-278593450</nova:project>
Nov 15 11:25:08 user nova-compute[76049]:       </nova:owner>
Nov 15 11:25:08 user nova-compute[76049]:       <nova:ports>
Nov 15 11:25:08 user nova-compute[76049]:         <nova:port uuid="3f38a8ea-3588-47c3-a10d-7f4787fe629d">
Nov 15 11:25:08 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 11:25:08 user nova-compute[76049]:         </nova:port>
Nov 15 11:25:08 user nova-compute[76049]:       </nova:ports>
Nov 15 11:25:08 user nova-compute[76049]:     </nova:instance>
Nov 15 11:25:08 user nova-compute[76049]:   </metadata>
Nov 15 11:25:08 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:25:08 user nova-compute[76049]:     <system>
Nov 15 11:25:08 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:25:08 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:25:08 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:25:08 user nova-compute[76049]:       <entry name="serial">6426e887-3097-4c19-9340-cd1a76131216</entry>
Nov 15 11:25:08 user nova-compute[76049]:       <entry name="uuid">6426e887-3097-4c19-9340-cd1a76131216</entry>
Nov 15 11:25:08 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:25:08 user nova-compute[76049]:     </system>
Nov 15 11:25:08 user nova-compute[76049]:   </sysinfo>
Nov 15 11:25:08 user nova-compute[76049]:   <os>
Nov 15 11:25:08 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:25:08 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:25:08 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:25:08 user nova-compute[76049]:   </os>
Nov 15 11:25:08 user nova-compute[76049]:   <features>
Nov 15 11:25:08 user nova-compute[76049]:     <acpi/>
Nov 15 11:25:08 user nova-compute[76049]:     <apic/>
Nov 15 11:25:08 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:25:08 user nova-compute[76049]:   </features>
Nov 15 11:25:08 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:25:08 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:25:08 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:25:08 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:25:08 user nova-compute[76049]:   </clock>
Nov 15 11:25:08 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:25:08 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:25:08 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:25:08 user nova-compute[76049]:   </cpu>
Nov 15 11:25:08 user nova-compute[76049]:   <devices>
Nov 15 11:25:08 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:25:08 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:25:08 user nova-compute[76049]:       <source dev="/dev/sdg"/>
Nov 15 11:25:08 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:25:08 user nova-compute[76049]:       <serial>c64321a7-fb06-4edb-ab36-3478e8c76d7c</serial>
Nov 15 11:25:08 user nova-compute[76049]:     </disk>
Nov 15 11:25:08 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:25:08 user nova-compute[76049]:       <mac address="fa:16:3e:a2:84:1d"/>
Nov 15 11:25:08 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:25:08 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:25:08 user nova-compute[76049]:       <target dev="tap3f38a8ea-35"/>
Nov 15 11:25:08 user nova-compute[76049]:     </interface>
Nov 15 11:25:08 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:25:08 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6426e887-3097-4c19-9340-cd1a76131216/console.log" append="off"/>
Nov 15 11:25:08 user nova-compute[76049]:     </serial>
Nov 15 11:25:08 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:25:08 user nova-compute[76049]:     <video>
Nov 15 11:25:08 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:25:08 user nova-compute[76049]:     </video>
Nov 15 11:25:08 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:25:08 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:25:08 user nova-compute[76049]:     </rng>
Nov 15 11:25:08 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:25:08 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:25:08 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:25:08 user nova-compute[76049]:     </memballoon>
Nov 15 11:25:08 user nova-compute[76049]:   </devices>
Nov 15 11:25:08 user nova-compute[76049]: </domain>
Nov 15 11:25:08 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1578483471',display_name='tempest-ServerActionsTestOtherA-server-1578483471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1578483471',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-mjy54lb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=6426e887-3097-4c19-9340-cd1a76131216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_vif [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2034931f-f472-509d-9f2c-5b0152bb2e9d', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Instance destroyed successfully.
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lazy-loading 'resources' on Instance uuid 6625217c-b0a0-48c1-972c-f460acd20013 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f38a8ea-35, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f38a8ea-35, col_values=(('qos', UUID('241b0aeb-50b6-4f91-a396-0d8995374e34')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f38a8ea-35, col_values=(('external_ids', {'iface-id': '3f38a8ea-3588-47c3-a10d-7f4787fe629d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:84:1d', 'vm-uuid': '6426e887-3097-4c19-9340-cd1a76131216'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1158016788',display_name='tempest-ServerActionsTestOtherB-server-1158016788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1158016788',id=26,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktOs3mWmesKA0843lLxBeSKSQx0m/mpUqKXLWx3fEo6ENpQRLnW7waCDyvFQPcJAN1IASGCDCsd62lXBqQcVvrX4OrEqNy7wgIy2ixhAvcpe5vU9XuAHWJ1n9eqNKzpw==',key_name='tempest-keypair-1200708761',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8953f0ed0ac04badb593529ffb2c567c',ramdisk_id='',reservation_id='r-eyw8tcmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1283239424',owner_user_name='tempest-ServerActionsTestOtherB-1283239424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfc6846a39a4455798a857842912c534',uuid=6625217c-b0a0-48c1-972c-f460acd20013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converting VIF {"id": "0495d054-d8d9-4a64-8306-3ae999cdb253", "address": "fa:16:3e:88:80:29", "network": {"id": "7e8afd4f-bd01-4e65-9b90-a2be62bd9e45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1906386754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8953f0ed0ac04badb593529ffb2c567c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0495d054-d8", "ovs_interfaceid": "0495d054-d8d9-4a64-8306-3ae999cdb253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_vif [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: INFO os_vif [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35')
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0495d054-d8, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff515d37-3693-42e0-a9af-eced9b4f07fc) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:08 user nova-compute[76049]: INFO os_vif [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:80:29,bridge_name='br-int',has_traffic_filtering=True,id=0495d054-d8d9-4a64-8306-3ae999cdb253,network=Network(7e8afd4f-bd01-4e65-9b90-a2be62bd9e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0495d054-d8')
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiWFmkwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:25:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No VIF found with MAC fa:16:3e:a2:84:1d, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3162abb-54bc-4b31-a924-be929463967d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:25:08 user nova-compute[76049]: No targets found.
Nov 15 11:25:08 user nova-compute[76049]: iSNS:
Nov 15 11:25:08 user nova-compute[76049]: No targets found.
Nov 15 11:25:08 user nova-compute[76049]: STATIC:
Nov 15 11:25:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:25:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:25:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b
Nov 15 11:25:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581
Nov 15 11:25:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:25:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:08 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:25:08 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:08 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:08 user nova-compute[76049]: FIRMWARE:
Nov 15 11:25:08 user nova-compute[76049]: No targets found.
Nov 15 11:25:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:25:08 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:25:08 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f2b64-1781-4dd1-8694-7ca3ac17d79e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2784a0ae-81b1-4eff-a14f-27c5e117913d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:08 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f626075aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d2b8f-3a31-4074-8251-4b8eac49c7f3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c814f3-fbbb-4c89-b194-564d51b57d65]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a7436a-3659-4936-9a1f-3b41bf1c5120]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3e8ce1-b373-4401-bc71-0ab20c7fac68]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[22565724-dece-4d3c-a1e3-ade23fb93634]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[89986a51-a8a7-42ef-952b-e2788db4e5e5]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260]
Nov 15 11:25:08 user nova-compute[76049]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581, portal: 172.16.0.220,3260] successful.
Nov 15 11:25:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4acd1da-cc65-4716-825f-f4b4ed278581 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b9c6c6-88bc-4e25-bad2-8bd4df6ff487]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] <== disconnect_volume: return (356ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:25:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Deleting instance files /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013_del
Nov 15 11:25:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Deletion of /opt/stack/data/nova/instances/6625217c-b0a0-48c1-972c-f460acd20013_del complete
Nov 15 11:25:08 user nova-compute[76049]: INFO nova.compute.manager [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 15 11:25:08 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:25:08 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-unplugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] Acquiring lock "6625217c-b0a0-48c1-972c-f460acd20013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] Lock "6625217c-b0a0-48c1-972c-f460acd20013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] No waiting events found dispatching network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:09 user nova-compute[76049]: WARNING nova.compute.manager [req-13c6f1b8-c14f-4883-9f02-a143fb499df9 req-5997e7c7-f640-4802-8545-6fc7dd457e0a service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received unexpected event network-vif-plugged-0495d054-d8d9-4a64-8306-3ae999cdb253 for instance with vm_state active and task_state deleting.
Nov 15 11:25:09 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:09 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Took 0.68 seconds to deallocate network for instance.
Nov 15 11:25:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:10 user nova-compute[76049]: INFO nova.compute.manager [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Took 0.99 seconds to detach 1 volumes for instance.
Nov 15 11:25:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:10 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:11 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Deleted allocations for instance 6625217c-b0a0-48c1-972c-f460acd20013
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3f1e8339-1bc5-4602-bf1e-4374a72c9684 tempest-ServerActionsTestOtherB-1283239424 tempest-ServerActionsTestOtherB-1283239424-project-member] Lock "6625217c-b0a0-48c1-972c-f460acd20013" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.849s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] [instance: 6625217c-b0a0-48c1-972c-f460acd20013] Received event network-vif-deleted-0495d054-d8d9-4a64-8306-3ae999cdb253 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:11 user nova-compute[76049]: WARNING nova.compute.manager [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received unexpected event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with vm_state building and task_state spawning.
Nov 15 11:25:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:11 user nova-compute[76049]: WARNING nova.compute.manager [req-e84390b9-dee3-400e-9734-1b58b4e95103 req-06c1662e-683a-4b5a-b133-5196f90b1d1e service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received unexpected event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with vm_state building and task_state spawning.
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:25:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance spawned successfully.
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:12 user nova-compute[76049]: INFO nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:25:12 user nova-compute[76049]: INFO nova.compute.manager [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Took 12.15 seconds to build instance.
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-9491eafa-dc03-4cc7-9e7b-73ccbe007a5c tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.282s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "1a79dd73-e1b9-4bc6-9867-068d622936fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:12 user nova-compute[76049]: INFO nova.compute.manager [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Terminating instance
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5a2cc5c-9844-45e7-a308-cf69d4b040b7 req-73faedc2-39d6-4b5b-8e81-2002735da1e2 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received event network-vif-unplugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5a2cc5c-9844-45e7-a308-cf69d4b040b7 req-73faedc2-39d6-4b5b-8e81-2002735da1e2 service nova] Acquiring lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5a2cc5c-9844-45e7-a308-cf69d4b040b7 req-73faedc2-39d6-4b5b-8e81-2002735da1e2 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5a2cc5c-9844-45e7-a308-cf69d4b040b7 req-73faedc2-39d6-4b5b-8e81-2002735da1e2 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5a2cc5c-9844-45e7-a308-cf69d4b040b7 req-73faedc2-39d6-4b5b-8e81-2002735da1e2 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] No waiting events found dispatching network-vif-unplugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5a2cc5c-9844-45e7-a308-cf69d4b040b7 req-73faedc2-39d6-4b5b-8e81-2002735da1e2 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received event network-vif-unplugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Instance destroyed successfully.
Nov 15 11:25:13 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lazy-loading 'resources' on Instance uuid 1a79dd73-e1b9-4bc6-9867-068d622936fb {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1113616424',display_name='tempest-VolumesActionsTest-instance-1113616424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1113616424',id=37,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef3a7d89bb9543fcb16dd1deeec8e0a2',ramdisk_id='',reservation_id='r-d2vtqlou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1320407360',owner_user_name='tempest-VolumesActionsTest-1320407360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:23:24Z,user_data=None,user_id='9dc5109be9754d0186a5ea21aaf4e505',uuid=1a79dd73-e1b9-4bc6-9867-068d622936fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Converting VIF {"id": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "address": "fa:16:3e:c3:1a:c3", "network": {"id": "c7916c1e-2c8d-4d21-a1b4-566300ac94f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-383680540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef3a7d89bb9543fcb16dd1deeec8e0a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf29a7ef-cb", "ovs_interfaceid": "af29a7ef-cb8f-47a7-87c1-cb241b3ea151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1a:c3,bridge_name='br-int',has_traffic_filtering=True,id=af29a7ef-cb8f-47a7-87c1-cb241b3ea151,network=Network(c7916c1e-2c8d-4d21-a1b4-566300ac94f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf29a7ef-cb') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG os_vif [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1a:c3,bridge_name='br-int',has_traffic_filtering=True,id=af29a7ef-cb8f-47a7-87c1-cb241b3ea151,network=Network(c7916c1e-2c8d-4d21-a1b4-566300ac94f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf29a7ef-cb') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf29a7ef-cb, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=359c5766-6017-43be-89ce-171a43f7dad4) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:13 user nova-compute[76049]: INFO os_vif [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1a:c3,bridge_name='br-int',has_traffic_filtering=True,id=af29a7ef-cb8f-47a7-87c1-cb241b3ea151,network=Network(c7916c1e-2c8d-4d21-a1b4-566300ac94f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf29a7ef-cb')
Nov 15 11:25:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Deleting instance files /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb_del
Nov 15 11:25:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Deletion of /opt/stack/data/nova/instances/1a79dd73-e1b9-4bc6-9867-068d622936fb_del complete
Nov 15 11:25:13 user nova-compute[76049]: INFO nova.compute.manager [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 15 11:25:13 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:25:13 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:14 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Took 0.50 seconds to deallocate network for instance.
Nov 15 11:25:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-c3601378-3c89-432c-bcad-398a35764344 req-ce360207-44d4-418a-ad50-59865534ae3e service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received event network-vif-deleted-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:14 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Deleted allocations for instance 1a79dd73-e1b9-4bc6-9867-068d622936fb
Nov 15 11:25:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c22f1298-73fb-42e2-b664-315de7a89125 tempest-VolumesActionsTest-1320407360 tempest-VolumesActionsTest-1320407360-project-member] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-a305ccd2-d20c-4200-9635-d7c5bce94215 req-6956a174-4ed7-4841-8d99-7d845664b986 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received event network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a305ccd2-d20c-4200-9635-d7c5bce94215 req-6956a174-4ed7-4841-8d99-7d845664b986 service nova] Acquiring lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a305ccd2-d20c-4200-9635-d7c5bce94215 req-6956a174-4ed7-4841-8d99-7d845664b986 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a305ccd2-d20c-4200-9635-d7c5bce94215 req-6956a174-4ed7-4841-8d99-7d845664b986 service nova] Lock "1a79dd73-e1b9-4bc6-9867-068d622936fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-a305ccd2-d20c-4200-9635-d7c5bce94215 req-6956a174-4ed7-4841-8d99-7d845664b986 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] No waiting events found dispatching network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:14 user nova-compute[76049]: WARNING nova.compute.manager [req-a305ccd2-d20c-4200-9635-d7c5bce94215 req-6956a174-4ed7-4841-8d99-7d845664b986 service nova] [instance: 1a79dd73-e1b9-4bc6-9867-068d622936fb] Received unexpected event network-vif-plugged-af29a7ef-cb8f-47a7-87c1-cb241b3ea151 for instance with vm_state deleted and task_state None.
Nov 15 11:25:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:25:21 user nova-compute[76049]: INFO nova.compute.claims [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Claim successful on node user
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:25:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.policy [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aab3b8846d7649a78b8f0be07f51945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66e129b2747494fb8fa7cb798b7dc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:25:21 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Creating image(s)
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "/opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "/opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:21 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk 1073741824" returned: 0 in 0.049s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Successfully created port: 677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Cannot resize image /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Ensure instance console log exists: /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Successfully updated port: 677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquired lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-changed-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Refreshing instance network info cache due to event network-changed-677b633e-c8cd-403f-81f2-a8d11f695029. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] Acquiring lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updating instance_info_cache with network_info: [{"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Releasing lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Instance network_info: |[{"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] Acquired lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Refreshing network info cache for port 677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Start _get_guest_xml network_info=[{"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:25:23 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:23 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-870433862',display_name='tempest-AttachVolumeTestJSON-server-870433862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-870433862',id=42,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz9vAAQ0beQlA44G7dwXiUm8yUVqcBhTQvvRULI+bM25yIHpw/ZcalUTWA7s/1T9VsMYhqXjzX2ZPcX1egZttD3Tilr5/P3995t7TddkIKKf6p5Hy25TKv1oJzqlJJTkQ==',key_name='tempest-keypair-49661704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-qp1c0stn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=d8ce85ec-1a8b-4231-80b7-dd7ce090f181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:3b,bridge_name='br-int',has_traffic_filtering=True,id=677b633e-c8cd-403f-81f2-a8d11f695029,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap677b633e-c8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'pci_devices' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:25:23 user nova-compute[76049]:   <uuid>d8ce85ec-1a8b-4231-80b7-dd7ce090f181</uuid>
Nov 15 11:25:23 user nova-compute[76049]:   <name>instance-0000002a</name>
Nov 15 11:25:23 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:25:23 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:25:23 user nova-compute[76049]:   <metadata>
Nov 15 11:25:23 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:25:23 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:25:23 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeTestJSON-server-870433862</nova:name>
Nov 15 11:25:23 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:25:23</nova:creationTime>
Nov 15 11:25:23 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:25:23 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:25:23 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:25:23 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:25:23 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:25:23 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:25:23 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:25:23 user nova-compute[76049]:       <nova:owner>
Nov 15 11:25:23 user nova-compute[76049]:         <nova:user uuid="aab3b8846d7649a78b8f0be07f51945e">tempest-AttachVolumeTestJSON-401613630-project-member</nova:user>
Nov 15 11:25:23 user nova-compute[76049]:         <nova:project uuid="b66e129b2747494fb8fa7cb798b7dc3c">tempest-AttachVolumeTestJSON-401613630</nova:project>
Nov 15 11:25:23 user nova-compute[76049]:       </nova:owner>
Nov 15 11:25:23 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:25:23 user nova-compute[76049]:       <nova:ports>
Nov 15 11:25:23 user nova-compute[76049]:         <nova:port uuid="677b633e-c8cd-403f-81f2-a8d11f695029">
Nov 15 11:25:23 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 11:25:23 user nova-compute[76049]:         </nova:port>
Nov 15 11:25:23 user nova-compute[76049]:       </nova:ports>
Nov 15 11:25:23 user nova-compute[76049]:     </nova:instance>
Nov 15 11:25:23 user nova-compute[76049]:   </metadata>
Nov 15 11:25:23 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:25:23 user nova-compute[76049]:     <system>
Nov 15 11:25:23 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:25:23 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:25:23 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:25:23 user nova-compute[76049]:       <entry name="serial">d8ce85ec-1a8b-4231-80b7-dd7ce090f181</entry>
Nov 15 11:25:23 user nova-compute[76049]:       <entry name="uuid">d8ce85ec-1a8b-4231-80b7-dd7ce090f181</entry>
Nov 15 11:25:23 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:25:23 user nova-compute[76049]:     </system>
Nov 15 11:25:23 user nova-compute[76049]:   </sysinfo>
Nov 15 11:25:23 user nova-compute[76049]:   <os>
Nov 15 11:25:23 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:25:23 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:25:23 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:25:23 user nova-compute[76049]:   </os>
Nov 15 11:25:23 user nova-compute[76049]:   <features>
Nov 15 11:25:23 user nova-compute[76049]:     <acpi/>
Nov 15 11:25:23 user nova-compute[76049]:     <apic/>
Nov 15 11:25:23 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:25:23 user nova-compute[76049]:   </features>
Nov 15 11:25:23 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:25:23 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:25:23 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:25:23 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:25:23 user nova-compute[76049]:   </clock>
Nov 15 11:25:23 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:25:23 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:25:23 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:25:23 user nova-compute[76049]:   </cpu>
Nov 15 11:25:23 user nova-compute[76049]:   <devices>
Nov 15 11:25:23 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:25:23 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:25:23 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk"/>
Nov 15 11:25:23 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:25:23 user nova-compute[76049]:     </disk>
Nov 15 11:25:23 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:25:23 user nova-compute[76049]:       <mac address="fa:16:3e:e2:33:3b"/>
Nov 15 11:25:23 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:25:23 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:25:23 user nova-compute[76049]:       <target dev="tap677b633e-c8"/>
Nov 15 11:25:23 user nova-compute[76049]:     </interface>
Nov 15 11:25:23 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:25:23 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/console.log" append="off"/>
Nov 15 11:25:23 user nova-compute[76049]:     </serial>
Nov 15 11:25:23 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:25:23 user nova-compute[76049]:     <video>
Nov 15 11:25:23 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:25:23 user nova-compute[76049]:     </video>
Nov 15 11:25:23 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:25:23 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:25:23 user nova-compute[76049]:     </rng>
Nov 15 11:25:23 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:25:23 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:25:23 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:25:23 user nova-compute[76049]:     </memballoon>
Nov 15 11:25:23 user nova-compute[76049]:   </devices>
Nov 15 11:25:23 user nova-compute[76049]: </domain>
Nov 15 11:25:23 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-870433862',display_name='tempest-AttachVolumeTestJSON-server-870433862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-870433862',id=42,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz9vAAQ0beQlA44G7dwXiUm8yUVqcBhTQvvRULI+bM25yIHpw/ZcalUTWA7s/1T9VsMYhqXjzX2ZPcX1egZttD3Tilr5/P3995t7TddkIKKf6p5Hy25TKv1oJzqlJJTkQ==',key_name='tempest-keypair-49661704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-qp1c0stn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=d8ce85ec-1a8b-4231-80b7-dd7ce090f181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:3b,bridge_name='br-int',has_traffic_filtering=True,id=677b633e-c8cd-403f-81f2-a8d11f695029,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap677b633e-c8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG os_vif [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:3b,bridge_name='br-int',has_traffic_filtering=True,id=677b633e-c8cd-403f-81f2-a8d11f695029,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap677b633e-c8') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7cd8356-a385-5adf-a636-9d2670229b56', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap677b633e-c8, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap677b633e-c8, col_values=(('qos', UUID('f2afc723-11c0-44ed-9d25-258e78f9c169')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap677b633e-c8, col_values=(('external_ids', {'iface-id': '677b633e-c8cd-403f-81f2-a8d11f695029', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:33:3b', 'vm-uuid': 'd8ce85ec-1a8b-4231-80b7-dd7ce090f181'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:23 user nova-compute[76049]: INFO os_vif [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:33:3b,bridge_name='br-int',has_traffic_filtering=True,id=677b633e-c8cd-403f-81f2-a8d11f695029,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap677b633e-c8')
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:25:23 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No VIF found with MAC fa:16:3e:e2:33:3b, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:25:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updated VIF entry in instance network info cache for port 677b633e-c8cd-403f-81f2-a8d11f695029. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:25:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updating instance_info_cache with network_info: [{"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-81192043-fcf2-4fb5-851d-ef1808381fee req-0ecf68f8-e5b0-4305-a2d8-726dfada5fe3 service nova] Releasing lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:25:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-7317759d-3102-496a-8a21-de1e7a3c9886 req-0430a916-1c02-4a19-afa3-b71883a30c98 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7317759d-3102-496a-8a21-de1e7a3c9886 req-0430a916-1c02-4a19-afa3-b71883a30c98 service nova] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7317759d-3102-496a-8a21-de1e7a3c9886 req-0430a916-1c02-4a19-afa3-b71883a30c98 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7317759d-3102-496a-8a21-de1e7a3c9886 req-0430a916-1c02-4a19-afa3-b71883a30c98 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-7317759d-3102-496a-8a21-de1e7a3c9886 req-0430a916-1c02-4a19-afa3-b71883a30c98 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] No waiting events found dispatching network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:25 user nova-compute[76049]: WARNING nova.compute.manager [req-7317759d-3102-496a-8a21-de1e7a3c9886 req-0430a916-1c02-4a19-afa3-b71883a30c98 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received unexpected event network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 for instance with vm_state building and task_state spawning.
Nov 15 11:25:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-5eefc75a-6b22-4ad3-860e-cd6e33fdddbc req-5b102805-4b7c-4265-99ba-5b7ae5b08887 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5eefc75a-6b22-4ad3-860e-cd6e33fdddbc req-5b102805-4b7c-4265-99ba-5b7ae5b08887 service nova] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5eefc75a-6b22-4ad3-860e-cd6e33fdddbc req-5b102805-4b7c-4265-99ba-5b7ae5b08887 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5eefc75a-6b22-4ad3-860e-cd6e33fdddbc req-5b102805-4b7c-4265-99ba-5b7ae5b08887 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-5eefc75a-6b22-4ad3-860e-cd6e33fdddbc req-5b102805-4b7c-4265-99ba-5b7ae5b08887 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] No waiting events found dispatching network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:27 user nova-compute[76049]: WARNING nova.compute.manager [req-5eefc75a-6b22-4ad3-860e-cd6e33fdddbc req-5b102805-4b7c-4265-99ba-5b7ae5b08887 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received unexpected event network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 for instance with vm_state building and task_state spawning.
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:25:27 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Instance spawned successfully.
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:25:27 user nova-compute[76049]: INFO nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 15 11:25:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:25:27 user nova-compute[76049]: INFO nova.compute.manager [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Took 6.63 seconds to build instance.
Nov 15 11:25:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f86cbdf5-2f56-490c-a71b-3690bb32b242 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.814s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating instance_info_cache with network_info: [{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:30 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:25:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:25:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:25:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:25:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:38 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7391MB free_disk=25.056671142578125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 733c26a3-786c-42bd-ac1b-684192a359e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6426e887-3097-4c19-9340-cd1a76131216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:25:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:25:39 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:25:39 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:25:39 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:25:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-changed-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Refreshing instance network info cache due to event network-changed-b80bc81d-bfad-4781-a6eb-33f8b2780974. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:25:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] Acquiring lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:25:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] Acquired lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:25:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Refreshing network info cache for port b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updated VIF entry in instance network info cache for port b80bc81d-bfad-4781-a6eb-33f8b2780974. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updating instance_info_cache with network_info: [{"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-800ca140-c988-4413-89ab-b20716f2a956 req-90080f0b-4655-4f02-83d5-65098071f565 service nova] Releasing lock "refresh_cache-733c26a3-786c-42bd-ac1b-684192a359e7" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "733c26a3-786c-42bd-ac1b-684192a359e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "733c26a3-786c-42bd-ac1b-684192a359e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:41 user nova-compute[76049]: INFO nova.compute.manager [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Terminating instance
Nov 15 11:25:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Instance destroyed successfully.
Nov 15 11:25:41 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'resources' on Instance uuid 733c26a3-786c-42bd-ac1b-684192a359e7 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1266316317',display_name='tempest-TestVolumeBootPattern-server-1266316317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1266316317',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-oz5o0y1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:24:00Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=733c26a3-786c-42bd-ac1b-684192a359e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "address": "fa:16:3e:cc:09:0e", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80bc81d-bf", "ovs_interfaceid": "b80bc81d-bfad-4781-a6eb-33f8b2780974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:09:0e,bridge_name='br-int',has_traffic_filtering=True,id=b80bc81d-bfad-4781-a6eb-33f8b2780974,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80bc81d-bf') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG os_vif [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:09:0e,bridge_name='br-int',has_traffic_filtering=True,id=b80bc81d-bfad-4781-a6eb-33f8b2780974,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80bc81d-bf') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb80bc81d-bf, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d599b1d-59e8-402d-9329-695666203ec2) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:42 user nova-compute[76049]: INFO os_vif [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:09:0e,bridge_name='br-int',has_traffic_filtering=True,id=b80bc81d-bfad-4781-a6eb-33f8b2780974,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80bc81d-bf')
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:25:42 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9320ae92-ddc7-4d3e-917f-58f774318de9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:25:42 user nova-compute[76049]: No targets found.
Nov 15 11:25:42 user nova-compute[76049]: iSNS:
Nov 15 11:25:42 user nova-compute[76049]: No targets found.
Nov 15 11:25:42 user nova-compute[76049]: STATIC:
Nov 15 11:25:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:25:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:25:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b
Nov 15 11:25:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:25:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:42 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:25:42 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:25:42 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:25:42 user nova-compute[76049]: FIRMWARE:
Nov 15 11:25:42 user nova-compute[76049]: No targets found.
Nov 15 11:25:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:25:42 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:25:42 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[887190d9-cf43-4570-909f-d2702e0868d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c37c9d-e673-4e66-bca8-3051a3d8d10d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:42 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629424d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d7441-eacb-4bb8-a3f0-1b13d78aafff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ead079-31b4-4b7d-b1d2-c2cd9786e722]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[108356a3-ccaf-41c4-bff7-87d0f19e5124]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1acbfa-bb7e-4827-8939-0bbdb8cb2a63]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO80361ab-17b825056bdbf9df', '/dev/disk/by-id/scsi-23137623832353035', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_80361ab') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4ed187-732e-4a3a-8512-b6f3785c3da8]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db0884-2e65-412f-8e9f-1dc7f6861b99]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e251af93-3fc1-4226-b61c-8176635f741b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]
Nov 15 11:25:42 user nova-compute[76049]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.
Nov 15 11:25:42 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fbe82e-006a-494f-b194-f1a2ea9b8c4a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== disconnect_volume: return (333ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:25:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Deleting instance files /opt/stack/data/nova/instances/733c26a3-786c-42bd-ac1b-684192a359e7_del
Nov 15 11:25:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Deletion of /opt/stack/data/nova/instances/733c26a3-786c-42bd-ac1b-684192a359e7_del complete
Nov 15 11:25:42 user nova-compute[76049]: INFO nova.compute.manager [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-vif-unplugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] Acquiring lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] No waiting events found dispatching network-vif-unplugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-vif-unplugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] Acquiring lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] Lock "733c26a3-786c-42bd-ac1b-684192a359e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] No waiting events found dispatching network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:42 user nova-compute[76049]: WARNING nova.compute.manager [req-ddf60992-4975-4db6-9609-6835f12afe3e req-78435b05-3545-4819-9ef7-06b1656edc26 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received unexpected event network-vif-plugged-b80bc81d-bfad-4781-a6eb-33f8b2780974 for instance with vm_state active and task_state deleting.
Nov 15 11:25:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:43 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-a94e0f69-def8-4453-8559-29bd7458b220 req-d31fe73e-542f-47a5-8ad9-ebc3b18a1ec1 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Received event network-vif-deleted-b80bc81d-bfad-4781-a6eb-33f8b2780974 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:43 user nova-compute[76049]: INFO nova.compute.manager [req-a94e0f69-def8-4453-8559-29bd7458b220 req-d31fe73e-542f-47a5-8ad9-ebc3b18a1ec1 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Neutron deleted interface b80bc81d-bfad-4781-a6eb-33f8b2780974; detaching it from the instance and deleting it from the info cache
Nov 15 11:25:43 user nova-compute[76049]: DEBUG nova.network.neutron [req-a94e0f69-def8-4453-8559-29bd7458b220 req-d31fe73e-542f-47a5-8ad9-ebc3b18a1ec1 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:43 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Took 0.80 seconds to deallocate network for instance.
Nov 15 11:25:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-a94e0f69-def8-4453-8559-29bd7458b220 req-d31fe73e-542f-47a5-8ad9-ebc3b18a1ec1 service nova] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Detach interface failed, port_id=b80bc81d-bfad-4781-a6eb-33f8b2780974, reason: Instance 733c26a3-786c-42bd-ac1b-684192a359e7 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:25:44 user nova-compute[76049]: INFO nova.compute.manager [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 733c26a3-786c-42bd-ac1b-684192a359e7] Took 0.89 seconds to detach 1 volumes for instance.
Nov 15 11:25:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:44 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:25:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:25:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:44 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Deleted allocations for instance 733c26a3-786c-42bd-ac1b-684192a359e7
Nov 15 11:25:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d34adea0-7b2a-464e-a304-da8e145b8bb7 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "733c26a3-786c-42bd-ac1b-684192a359e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.406s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:45 user nova-compute[76049]: INFO nova.compute.manager [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Rescuing
Nov 15 11:25:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:25:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:25:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Updating instance_info_cache with network_info: [{"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-d51d72ca-7b7b-48e4-ab0d-ce550d623e41 req-e3457590-c692-4ef5-809d-f1a3b628f61c service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d51d72ca-7b7b-48e4-ab0d-ce550d623e41 req-e3457590-c692-4ef5-809d-f1a3b628f61c service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d51d72ca-7b7b-48e4-ab0d-ce550d623e41 req-e3457590-c692-4ef5-809d-f1a3b628f61c service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d51d72ca-7b7b-48e4-ab0d-ce550d623e41 req-e3457590-c692-4ef5-809d-f1a3b628f61c service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-d51d72ca-7b7b-48e4-ab0d-ce550d623e41 req-e3457590-c692-4ef5-809d-f1a3b628f61c service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:46 user nova-compute[76049]: WARNING nova.compute.manager [req-d51d72ca-7b7b-48e4-ab0d-ce550d623e41 req-e3457590-c692-4ef5-809d-f1a3b628f61c service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state active and task_state rescuing.
Nov 15 11:25:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance destroyed successfully.
Nov 15 11:25:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Attempting a stable device rescue
Nov 15 11:25:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76049) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:25:47 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Creating image(s)
Nov 15 11:25:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "/opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "/opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG nova.objects.instance [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "89730317cd756cd8cb82a48c13bf1a4bc0403229" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "89730317cd756cd8cb82a48c13bf1a4bc0403229" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.part --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG nova.virt.images [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] a95a2f75-f04e-4b2c-bf5b-0e02bf468d26 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.part /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-bac940ae-9650-4dd7-b1ae-6536c636fd13 req-d911193d-8dd0-4c33-98ae-ccc2c131dee6 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bac940ae-9650-4dd7-b1ae-6536c636fd13 req-d911193d-8dd0-4c33-98ae-ccc2c131dee6 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bac940ae-9650-4dd7-b1ae-6536c636fd13 req-d911193d-8dd0-4c33-98ae-ccc2c131dee6 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bac940ae-9650-4dd7-b1ae-6536c636fd13 req-d911193d-8dd0-4c33-98ae-ccc2c131dee6 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-bac940ae-9650-4dd7-b1ae-6536c636fd13 req-d911193d-8dd0-4c33-98ae-ccc2c131dee6 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:48 user nova-compute[76049]: WARNING nova.compute.manager [req-bac940ae-9650-4dd7-b1ae-6536c636fd13 req-d911193d-8dd0-4c33-98ae-ccc2c131dee6 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state active and task_state rescuing.
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.part /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.converted" returned: 0 in 0.256s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "89730317cd756cd8cb82a48c13bf1a4bc0403229" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.581s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "89730317cd756cd8cb82a48c13bf1a4bc0403229" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "89730317cd756cd8cb82a48c13bf1a4bc0403229" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229 --force-share --output=json" returned: 0 in 0.165s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229,backing_fmt=raw /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.rescue {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229,backing_fmt=raw /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.rescue" returned: 0 in 0.047s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "89730317cd756cd8cb82a48c13bf1a4bc0403229" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'migration_context' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<7220132d-4ce3-4dfb-b119-4bc6c163fcd8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Start _get_guest_xml network_info=[{"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "vif_mac": "fa:16:3e:86:56:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a95a2f75-f04e-4b2c-bf5b-0e02bf468d26', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjkQmdhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '7220132d-4ce3-4dfb-b119-4bc6c163fcd8', 'attached_at': '', 'detached_at': '', 'volume_id': '8d426c2c-08bd-4f23-8733-52e4255dda67', 'serial': '8d426c2c-08bd-4f23-8733-52e4255dda67'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5907f18b-f96e-4088-bc53-c11ae48cdd42', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'resources' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<7220132d-4ce3-4dfb-b119-4bc6c163fcd8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'numa_topology' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<7220132d-4ce3-4dfb-b119-4bc6c163fcd8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:25:49 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:49 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<7220132d-4ce3-4dfb-b119-4bc6c163fcd8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjkQmdhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:25:49 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:25:49 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:25:49 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e7730b-ac01-45c7-abd5-44d02aa2f7ac]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yjkQmdhe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 11:25:49 user nova-compute[76049]: node.name = iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:25:49 user nova-compute[76049]: node.tpgt = -1
Nov 15 11:25:49 user nova-compute[76049]: node.startup = automatic
Nov 15 11:25:49 user nova-compute[76049]: node.leading_login = No
Nov 15 11:25:49 user nova-compute[76049]: iface.iscsi_ifacename = default
Nov 15 11:25:49 user nova-compute[76049]: iface.net_ifacename = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.ipaddress = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.prefix_len = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.hwaddress = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.transport_name = tcp
Nov 15 11:25:49 user nova-compute[76049]: iface.initiatorname = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.state = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.vlan_id = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.vlan_priority = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.vlan_state = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.iface_num = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.mtu = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.port = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.bootproto = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.subnet_mask = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.gateway = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_alt_client_id = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_dns = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_learn_iqn = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_vendor_id_state = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_vendor_id = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.dhcp_slp_da = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.fragmentation = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.gratuitous_arp = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.incoming_forwarding = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.tos_state = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.tos = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.ttl = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.delayed_ack = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.tcp_nagle = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.tcp_wsf_state = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.tcp_wsf = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.tcp_timer_scale = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.tcp_timestamp = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.redirect = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.def_task_mgmt_timeout = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.header_digest = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.data_digest = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.immediate_data = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.initial_r2t = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.data_seq_inorder = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.data_pdu_inorder = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.erl = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.max_receive_data_len = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.first_burst_len = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.max_outstanding_r2t = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.max_burst_len = 0
Nov 15 11:25:49 user nova-compute[76049]: iface.chap_auth = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.bidi_chap = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.strict_login_compliance = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.discovery_auth = <empty>
Nov 15 11:25:49 user nova-compute[76049]: iface.discovery_logout = <empty>
Nov 15 11:25:49 user nova-compute[76049]: node.discovery_address = <empty>
Nov 15 11:25:49 user nova-compute[76049]: node.discovery_port = 0
Nov 15 11:25:49 user nova-compute[76049]: node.discovery_type = static
Nov 15 11:25:49 user nova-compute[76049]: node.session.initial_cmdsn = 0
Nov 15 11:25:49 user nova-compute[76049]: node.session.initial_login_retry_max = 8
Nov 15 11:25:49 user nova-compute[76049]: node.session.xmit_thread_priority = -20
Nov 15 11:25:49 user nova-compute[76049]: node.session.cmds_max = 128
Nov 15 11:25:49 user nova-compute[76049]: node.session.queue_depth = 32
Nov 15 11:25:49 user nova-compute[76049]: node.session.nr_sessions = 1
Nov 15 11:25:49 user nova-compute[76049]: node.session.auth.authmethod = CHAP
Nov 15 11:25:49 user nova-compute[76049]: node.session.auth.username = yjkQmdhe
Nov 15 11:25:49 user nova-compute[76049]: node.session.auth.password = ***
Nov 15 11:25:49 user nova-compute[76049]: node.session.auth.username_in = <empty>
Nov 15 11:25:49 user nova-compute[76049]: node.session.auth.password_in = <empty>
Nov 15 11:25:49 user nova-compute[76049]: node.session.auth.chap_algs = MD5
Nov 15 11:25:49 user nova-compute[76049]: node.session.timeo.replacement_timeout = 120
Nov 15 11:25:49 user nova-compute[76049]: node.session.err_timeo.abort_timeout = 15
Nov 15 11:25:49 user nova-compute[76049]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 11:25:49 user nova-compute[76049]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 11:25:49 user nova-compute[76049]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.FastAbort = Yes
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.InitialR2T = No
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.ImmediateData = Yes
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.MaxConnections = 1
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 11:25:49 user nova-compute[76049]: node.session.iscsi.ERL = 0
Nov 15 11:25:49 user nova-compute[76049]: node.session.scan = manual
Nov 15 11:25:49 user nova-compute[76049]: node.session.reopen_max = 0
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].address = 172.16.0.220
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].port = 3260
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].startup = manual
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].tcp.window_size = 524288
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].tcp.type_of_service = 0
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].timeo.logout_timeout = 15
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].timeo.login_timeout = 15
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].timeo.auth_timeout = 45
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].iscsi.DataDigest = None
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].iscsi.IFMarker = No
Nov 15 11:25:49 user nova-compute[76049]: node.conn[0].iscsi.OFMarker = No
Nov 15 11:25:49 user nova-compute[76049]: # END RECORD
Nov 15 11:25:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed55a8-90c7-4cfe-b957-aa1f9f59fa38]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74be2a7-b46c-4023-bdc2-ce2018698c36]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjkQmdhe {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjkQmdhe" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9219a1e6-c89c-4381-b5ae-50fe3fdd3766]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjkQmdhe'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8240a3-512f-42a1-8bd7-effb8fcee30a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50ebcc1-918c-4f24-a8aa-fef7e40cf8df]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:49 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:49 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:49 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:25:49 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:25:49 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:25:49 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:25:49 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] HCTL ('37', '0', '0', 0) found on session 50 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c6867c-bcfb-4b47-a130-67d77456608d]: (4, ('0 0 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Searching for a device in session 50 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjkQmdhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '23537653137343639', 'path': '/dev/sdf'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653137343639', 'path': '/dev/sdf'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911990954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-911990954',id=39,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-7vl5d4pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:24:13Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=7220132d-4ce3-4dfb-b119-4bc6c163fcd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "vif_mac": "fa:16:3e:86:56:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "vif_mac": "fa:16:3e:86:56:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'pci_devices' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.objects.base [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Object Instance<7220132d-4ce3-4dfb-b119-4bc6c163fcd8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:25:49 user nova-compute[76049]:   <uuid>7220132d-4ce3-4dfb-b119-4bc6c163fcd8</uuid>
Nov 15 11:25:49 user nova-compute[76049]:   <name>instance-00000027</name>
Nov 15 11:25:49 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:25:49 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:25:49 user nova-compute[76049]:   <metadata>
Nov 15 11:25:49 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:25:49 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:25:49 user nova-compute[76049]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-911990954</nova:name>
Nov 15 11:25:49 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:25:49</nova:creationTime>
Nov 15 11:25:49 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:25:49 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:25:49 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:25:49 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:25:49 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:25:49 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:25:49 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:25:49 user nova-compute[76049]:       <nova:owner>
Nov 15 11:25:49 user nova-compute[76049]:         <nova:user uuid="81bd63b00a9c4f8983e335cf898f77ad">tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member</nova:user>
Nov 15 11:25:49 user nova-compute[76049]:         <nova:project uuid="25a9fe3c211d4bb78b9c6878147a9c75">tempest-ServerBootFromVolumeStableRescueTest-1027868851</nova:project>
Nov 15 11:25:49 user nova-compute[76049]:       </nova:owner>
Nov 15 11:25:49 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:25:49 user nova-compute[76049]:       <nova:ports>
Nov 15 11:25:49 user nova-compute[76049]:         <nova:port uuid="8a1e98aa-536d-4e05-9833-e8c663128e8c">
Nov 15 11:25:49 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 11:25:49 user nova-compute[76049]:         </nova:port>
Nov 15 11:25:49 user nova-compute[76049]:       </nova:ports>
Nov 15 11:25:49 user nova-compute[76049]:     </nova:instance>
Nov 15 11:25:49 user nova-compute[76049]:   </metadata>
Nov 15 11:25:49 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:25:49 user nova-compute[76049]:     <system>
Nov 15 11:25:49 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:25:49 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:25:49 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:25:49 user nova-compute[76049]:       <entry name="serial">7220132d-4ce3-4dfb-b119-4bc6c163fcd8</entry>
Nov 15 11:25:49 user nova-compute[76049]:       <entry name="uuid">7220132d-4ce3-4dfb-b119-4bc6c163fcd8</entry>
Nov 15 11:25:49 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:25:49 user nova-compute[76049]:     </system>
Nov 15 11:25:49 user nova-compute[76049]:   </sysinfo>
Nov 15 11:25:49 user nova-compute[76049]:   <os>
Nov 15 11:25:49 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:25:49 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:25:49 user nova-compute[76049]:   </os>
Nov 15 11:25:49 user nova-compute[76049]:   <features>
Nov 15 11:25:49 user nova-compute[76049]:     <acpi/>
Nov 15 11:25:49 user nova-compute[76049]:     <apic/>
Nov 15 11:25:49 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:25:49 user nova-compute[76049]:   </features>
Nov 15 11:25:49 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:25:49 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:25:49 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:25:49 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:25:49 user nova-compute[76049]:   </clock>
Nov 15 11:25:49 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:25:49 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:25:49 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:25:49 user nova-compute[76049]:   </cpu>
Nov 15 11:25:49 user nova-compute[76049]:   <devices>
Nov 15 11:25:49 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:25:49 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:25:49 user nova-compute[76049]:       <source dev="/dev/sdf"/>
Nov 15 11:25:49 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:25:49 user nova-compute[76049]:       <serial>8d426c2c-08bd-4f23-8733-52e4255dda67</serial>
Nov 15 11:25:49 user nova-compute[76049]:     </disk>
Nov 15 11:25:49 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:25:49 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:25:49 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.rescue"/>
Nov 15 11:25:49 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:25:49 user nova-compute[76049]:       <boot order="1"/>
Nov 15 11:25:49 user nova-compute[76049]:     </disk>
Nov 15 11:25:49 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:25:49 user nova-compute[76049]:       <mac address="fa:16:3e:86:56:10"/>
Nov 15 11:25:49 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:25:49 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:25:49 user nova-compute[76049]:       <target dev="tap8a1e98aa-53"/>
Nov 15 11:25:49 user nova-compute[76049]:     </interface>
Nov 15 11:25:49 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:25:49 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/console.log" append="off"/>
Nov 15 11:25:49 user nova-compute[76049]:     </serial>
Nov 15 11:25:49 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:25:49 user nova-compute[76049]:     <video>
Nov 15 11:25:49 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:25:49 user nova-compute[76049]:     </video>
Nov 15 11:25:49 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:25:49 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:25:49 user nova-compute[76049]:     </rng>
Nov 15 11:25:49 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:25:49 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:25:49 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:25:49 user nova-compute[76049]:     </memballoon>
Nov 15 11:25:49 user nova-compute[76049]:   </devices>
Nov 15 11:25:49 user nova-compute[76049]: </domain>
Nov 15 11:25:49 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:25:49 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance destroyed successfully.
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:25:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] No VIF found with MAC fa:16:3e:86:56:10, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:25:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-74917562-b38d-4c4a-affa-88cf679b9cc7 req-fb543920-ac55-423b-87a7-49c2d33f38ce service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-74917562-b38d-4c4a-affa-88cf679b9cc7 req-fb543920-ac55-423b-87a7-49c2d33f38ce service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-74917562-b38d-4c4a-affa-88cf679b9cc7 req-fb543920-ac55-423b-87a7-49c2d33f38ce service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-74917562-b38d-4c4a-affa-88cf679b9cc7 req-fb543920-ac55-423b-87a7-49c2d33f38ce service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-74917562-b38d-4c4a-affa-88cf679b9cc7 req-fb543920-ac55-423b-87a7-49c2d33f38ce service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:51 user nova-compute[76049]: WARNING nova.compute.manager [req-74917562-b38d-4c4a-affa-88cf679b9cc7 req-fb543920-ac55-423b-87a7-49c2d33f38ce service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state active and task_state rescuing.
Nov 15 11:25:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:53 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d71212e-1c2a-42f6-99d2-6dc6c7fb626a req-f3f5e9f2-4e5d-407f-b388-ae702b3f64a0 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:25:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d71212e-1c2a-42f6-99d2-6dc6c7fb626a req-f3f5e9f2-4e5d-407f-b388-ae702b3f64a0 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:25:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d71212e-1c2a-42f6-99d2-6dc6c7fb626a req-f3f5e9f2-4e5d-407f-b388-ae702b3f64a0 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:25:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d71212e-1c2a-42f6-99d2-6dc6c7fb626a req-f3f5e9f2-4e5d-407f-b388-ae702b3f64a0 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:25:53 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d71212e-1c2a-42f6-99d2-6dc6c7fb626a req-f3f5e9f2-4e5d-407f-b388-ae702b3f64a0 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:25:53 user nova-compute[76049]: WARNING nova.compute.manager [req-5d71212e-1c2a-42f6-99d2-6dc6c7fb626a req-f3f5e9f2-4e5d-407f-b388-ae702b3f64a0 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state active and task_state rescuing.
Nov 15 11:25:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-df77fe98-1629-4a43-89bf-ac8eb4f17f51 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:25:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:25:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:26:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:26:12 user nova-compute[76049]: INFO nova.compute.claims [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Claim successful on node user
Nov 15 11:26:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:26:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.policy [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a364f470c402bbd91712302c611cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde1d2d3e99a4c96ab95220df3de4ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:26:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Creating image(s)
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.226s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:13 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:26:13 user nova-compute[76049]: INFO nova.compute.claims [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Claim successful on node user
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk 1073741824" returned: 0 in 0.058s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Successfully created port: edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Cannot resize image /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Ensure instance console log exists: /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:26:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.policy [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a364f470c402bbd91712302c611cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde1d2d3e99a4c96ab95220df3de4ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:26:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Creating image(s)
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Successfully updated port: edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-changed-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Refreshing instance network info cache due to event network-changed-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.network.neutron [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Refreshing network info cache for port edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG nova.network.neutron [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-09537a5c-168d-47d5-ab64-3550de740ff9 req-1b66893b-7d50-478f-b384-39b1e80d12f4 service nova] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk 1073741824" returned: 0 in 0.052s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Successfully created port: 6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance network_info: |[{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Start _get_guest_xml network_info=[{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:26:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:15 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674425469',display_name='tempest-ServerRescueNegativeTestJSON-server-674425469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674425469',id=43,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-tmhj757s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:14Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=abc51297-8f1e-46d6-b1ae-843c34d7cbf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'pci_devices' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:26:15 user nova-compute[76049]:   <uuid>abc51297-8f1e-46d6-b1ae-843c34d7cbf3</uuid>
Nov 15 11:26:15 user nova-compute[76049]:   <name>instance-0000002b</name>
Nov 15 11:26:15 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:26:15 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:26:15 user nova-compute[76049]:   <metadata>
Nov 15 11:26:15 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:26:15 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:26:15 user nova-compute[76049]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674425469</nova:name>
Nov 15 11:26:15 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:26:15</nova:creationTime>
Nov 15 11:26:15 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:26:15 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:26:15 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:26:15 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:26:15 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:26:15 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:26:15 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:26:15 user nova-compute[76049]:       <nova:owner>
Nov 15 11:26:15 user nova-compute[76049]:         <nova:user uuid="ab6a364f470c402bbd91712302c611cd">tempest-ServerRescueNegativeTestJSON-47045426-project-member</nova:user>
Nov 15 11:26:15 user nova-compute[76049]:         <nova:project uuid="fde1d2d3e99a4c96ab95220df3de4ad4">tempest-ServerRescueNegativeTestJSON-47045426</nova:project>
Nov 15 11:26:15 user nova-compute[76049]:       </nova:owner>
Nov 15 11:26:15 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:26:15 user nova-compute[76049]:       <nova:ports>
Nov 15 11:26:15 user nova-compute[76049]:         <nova:port uuid="edd140bd-2737-4f7c-b54c-d59a6a2d7ddb">
Nov 15 11:26:15 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 11:26:15 user nova-compute[76049]:         </nova:port>
Nov 15 11:26:15 user nova-compute[76049]:       </nova:ports>
Nov 15 11:26:15 user nova-compute[76049]:     </nova:instance>
Nov 15 11:26:15 user nova-compute[76049]:   </metadata>
Nov 15 11:26:15 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:26:15 user nova-compute[76049]:     <system>
Nov 15 11:26:15 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:26:15 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:26:15 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:26:15 user nova-compute[76049]:       <entry name="serial">abc51297-8f1e-46d6-b1ae-843c34d7cbf3</entry>
Nov 15 11:26:15 user nova-compute[76049]:       <entry name="uuid">abc51297-8f1e-46d6-b1ae-843c34d7cbf3</entry>
Nov 15 11:26:15 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:26:15 user nova-compute[76049]:     </system>
Nov 15 11:26:15 user nova-compute[76049]:   </sysinfo>
Nov 15 11:26:15 user nova-compute[76049]:   <os>
Nov 15 11:26:15 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:26:15 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:26:15 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:26:15 user nova-compute[76049]:   </os>
Nov 15 11:26:15 user nova-compute[76049]:   <features>
Nov 15 11:26:15 user nova-compute[76049]:     <acpi/>
Nov 15 11:26:15 user nova-compute[76049]:     <apic/>
Nov 15 11:26:15 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:26:15 user nova-compute[76049]:   </features>
Nov 15 11:26:15 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:26:15 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:26:15 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:26:15 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:26:15 user nova-compute[76049]:   </clock>
Nov 15 11:26:15 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:26:15 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:26:15 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:26:15 user nova-compute[76049]:   </cpu>
Nov 15 11:26:15 user nova-compute[76049]:   <devices>
Nov 15 11:26:15 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:26:15 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:26:15 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk"/>
Nov 15 11:26:15 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:26:15 user nova-compute[76049]:     </disk>
Nov 15 11:26:15 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:26:15 user nova-compute[76049]:       <mac address="fa:16:3e:36:70:c7"/>
Nov 15 11:26:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:26:15 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:26:15 user nova-compute[76049]:       <target dev="tapedd140bd-27"/>
Nov 15 11:26:15 user nova-compute[76049]:     </interface>
Nov 15 11:26:15 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:26:15 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/console.log" append="off"/>
Nov 15 11:26:15 user nova-compute[76049]:     </serial>
Nov 15 11:26:15 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:26:15 user nova-compute[76049]:     <video>
Nov 15 11:26:15 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:26:15 user nova-compute[76049]:     </video>
Nov 15 11:26:15 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:26:15 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:26:15 user nova-compute[76049]:     </rng>
Nov 15 11:26:15 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:26:15 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:26:15 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:26:15 user nova-compute[76049]:     </memballoon>
Nov 15 11:26:15 user nova-compute[76049]:   </devices>
Nov 15 11:26:15 user nova-compute[76049]: </domain>
Nov 15 11:26:15 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674425469',display_name='tempest-ServerRescueNegativeTestJSON-server-674425469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674425469',id=43,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-tmhj757s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:14Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=abc51297-8f1e-46d6-b1ae-843c34d7cbf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG os_vif [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ac9e86c-2c2b-5e35-9481-46294581ac32', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Cannot resize image /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Ensure instance console log exists: /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd140bd-27, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedd140bd-27, col_values=(('qos', UUID('dd4b5355-91b1-45ae-9c81-8b6c33a5e64e')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedd140bd-27, col_values=(('external_ids', {'iface-id': 'edd140bd-2737-4f7c-b54c-d59a6a2d7ddb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:70:c7', 'vm-uuid': 'abc51297-8f1e-46d6-b1ae-843c34d7cbf3'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:15 user nova-compute[76049]: INFO os_vif [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27')
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No VIF found with MAC fa:16:3e:36:70:c7, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_power_states {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Successfully updated port: 6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:26:15 user nova-compute[76049]: DEBUG nova.network.neutron [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-changed-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Refreshing instance network info cache due to event network-changed-6ca7af5f-fb76-4126-924c-2fb495e47964. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] Acquiring lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.neutron [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance network_info: |[{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] Acquired lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Refreshing network info cache for port 6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Start _get_guest_xml network_info=[{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:26:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44323748',display_name='tempest-ServerRescueNegativeTestJSON-server-44323748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44323748',id=44,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-bfaao6du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:15Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=8b274e91-15bd-49c1-8fee-12908102ee15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.objects.instance [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:26:16 user nova-compute[76049]:   <uuid>8b274e91-15bd-49c1-8fee-12908102ee15</uuid>
Nov 15 11:26:16 user nova-compute[76049]:   <name>instance-0000002c</name>
Nov 15 11:26:16 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:26:16 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:26:16 user nova-compute[76049]:   <metadata>
Nov 15 11:26:16 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:26:16 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:26:16 user nova-compute[76049]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-44323748</nova:name>
Nov 15 11:26:16 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:26:16</nova:creationTime>
Nov 15 11:26:16 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:26:16 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:26:16 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:26:16 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:26:16 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:26:16 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:26:16 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:26:16 user nova-compute[76049]:       <nova:owner>
Nov 15 11:26:16 user nova-compute[76049]:         <nova:user uuid="ab6a364f470c402bbd91712302c611cd">tempest-ServerRescueNegativeTestJSON-47045426-project-member</nova:user>
Nov 15 11:26:16 user nova-compute[76049]:         <nova:project uuid="fde1d2d3e99a4c96ab95220df3de4ad4">tempest-ServerRescueNegativeTestJSON-47045426</nova:project>
Nov 15 11:26:16 user nova-compute[76049]:       </nova:owner>
Nov 15 11:26:16 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:26:16 user nova-compute[76049]:       <nova:ports>
Nov 15 11:26:16 user nova-compute[76049]:         <nova:port uuid="6ca7af5f-fb76-4126-924c-2fb495e47964">
Nov 15 11:26:16 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:26:16 user nova-compute[76049]:         </nova:port>
Nov 15 11:26:16 user nova-compute[76049]:       </nova:ports>
Nov 15 11:26:16 user nova-compute[76049]:     </nova:instance>
Nov 15 11:26:16 user nova-compute[76049]:   </metadata>
Nov 15 11:26:16 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:26:16 user nova-compute[76049]:     <system>
Nov 15 11:26:16 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:26:16 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:26:16 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:26:16 user nova-compute[76049]:       <entry name="serial">8b274e91-15bd-49c1-8fee-12908102ee15</entry>
Nov 15 11:26:16 user nova-compute[76049]:       <entry name="uuid">8b274e91-15bd-49c1-8fee-12908102ee15</entry>
Nov 15 11:26:16 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:26:16 user nova-compute[76049]:     </system>
Nov 15 11:26:16 user nova-compute[76049]:   </sysinfo>
Nov 15 11:26:16 user nova-compute[76049]:   <os>
Nov 15 11:26:16 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:26:16 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:26:16 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:26:16 user nova-compute[76049]:   </os>
Nov 15 11:26:16 user nova-compute[76049]:   <features>
Nov 15 11:26:16 user nova-compute[76049]:     <acpi/>
Nov 15 11:26:16 user nova-compute[76049]:     <apic/>
Nov 15 11:26:16 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:26:16 user nova-compute[76049]:   </features>
Nov 15 11:26:16 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:26:16 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:26:16 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:26:16 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:26:16 user nova-compute[76049]:   </clock>
Nov 15 11:26:16 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:26:16 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:26:16 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:26:16 user nova-compute[76049]:   </cpu>
Nov 15 11:26:16 user nova-compute[76049]:   <devices>
Nov 15 11:26:16 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:26:16 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:26:16 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk"/>
Nov 15 11:26:16 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:26:16 user nova-compute[76049]:     </disk>
Nov 15 11:26:16 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:26:16 user nova-compute[76049]:       <mac address="fa:16:3e:56:a1:c3"/>
Nov 15 11:26:16 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:26:16 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:26:16 user nova-compute[76049]:       <target dev="tap6ca7af5f-fb"/>
Nov 15 11:26:16 user nova-compute[76049]:     </interface>
Nov 15 11:26:16 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:26:16 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/console.log" append="off"/>
Nov 15 11:26:16 user nova-compute[76049]:     </serial>
Nov 15 11:26:16 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:26:16 user nova-compute[76049]:     <video>
Nov 15 11:26:16 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:26:16 user nova-compute[76049]:     </video>
Nov 15 11:26:16 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:26:16 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:26:16 user nova-compute[76049]:     </rng>
Nov 15 11:26:16 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:26:16 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:26:16 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:26:16 user nova-compute[76049]:     </memballoon>
Nov 15 11:26:16 user nova-compute[76049]:   </devices>
Nov 15 11:26:16 user nova-compute[76049]: </domain>
Nov 15 11:26:16 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44323748',display_name='tempest-ServerRescueNegativeTestJSON-server-44323748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44323748',id=44,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-bfaao6du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:15Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=8b274e91-15bd-49c1-8fee-12908102ee15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG os_vif [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa628810-c33c-5970-ba4a-90e4ae5108c1', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ca7af5f-fb, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ca7af5f-fb, col_values=(('qos', UUID('bed0831f-e226-45bd-ba5c-fba7162fb793')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ca7af5f-fb, col_values=(('external_ids', {'iface-id': '6ca7af5f-fb76-4126-924c-2fb495e47964', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:a1:c3', 'vm-uuid': '8b274e91-15bd-49c1-8fee-12908102ee15'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:16 user nova-compute[76049]: INFO os_vif [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb')
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No VIF found with MAC fa:16:3e:56:a1:c3, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updated VIF entry in instance network info cache for port 6ca7af5f-fb76-4126-924c-2fb495e47964. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG nova.network.neutron [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-701d7da0-52c5-4045-91b5-b4940eccf73e req-abf1917b-578e-4c1e-b07b-109ba4c28896 service nova] Releasing lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-68cec3a7-1280-4c21-981b-5eef7f21ed23 req-b4f5f38f-e6e0-4cc0-88f1-9995c003f22e service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-68cec3a7-1280-4c21-981b-5eef7f21ed23 req-b4f5f38f-e6e0-4cc0-88f1-9995c003f22e service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-68cec3a7-1280-4c21-981b-5eef7f21ed23 req-b4f5f38f-e6e0-4cc0-88f1-9995c003f22e service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-68cec3a7-1280-4c21-981b-5eef7f21ed23 req-b4f5f38f-e6e0-4cc0-88f1-9995c003f22e service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-68cec3a7-1280-4c21-981b-5eef7f21ed23 req-b4f5f38f-e6e0-4cc0-88f1-9995c003f22e service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:18 user nova-compute[76049]: WARNING nova.compute.manager [req-68cec3a7-1280-4c21-981b-5eef7f21ed23 req-b4f5f38f-e6e0-4cc0-88f1-9995c003f22e service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state building and task_state spawning.
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-3feb1554-dd64-4f8e-a8d6-0a082b06a540 req-b87db472-f4f0-4472-93aa-72b891172450 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3feb1554-dd64-4f8e-a8d6-0a082b06a540 req-b87db472-f4f0-4472-93aa-72b891172450 service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3feb1554-dd64-4f8e-a8d6-0a082b06a540 req-b87db472-f4f0-4472-93aa-72b891172450 service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3feb1554-dd64-4f8e-a8d6-0a082b06a540 req-b87db472-f4f0-4472-93aa-72b891172450 service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-3feb1554-dd64-4f8e-a8d6-0a082b06a540 req-b87db472-f4f0-4472-93aa-72b891172450 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:18 user nova-compute[76049]: WARNING nova.compute.manager [req-3feb1554-dd64-4f8e-a8d6-0a082b06a540 req-b87db472-f4f0-4472-93aa-72b891172450 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received unexpected event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with vm_state building and task_state spawning.
Nov 15 11:26:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:19 user nova-compute[76049]: WARNING nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid d0f0287a-5e2c-4a02-8490-da45ae1e86b9 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 25c772f6-5656-46b5-9461-d720314b29ae {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid b3633502-a889-43a5-96df-ad92136e1231 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 79b1e190-6f5c-4546-88de-31d8a3ec36b9 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 6c9ce91d-18c5-478a-83ae-2f9b374c1416 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 6426e887-3097-4c19-9340-cd1a76131216 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "25c772f6-5656-46b5-9461-d720314b29ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8697e4ed-461e-4544-8137-faf180d111be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "b3633502-a889-43a5-96df-ad92136e1231" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "6426e887-3097-4c19-9340-cd1a76131216" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "25c772f6-5656-46b5-9461-d720314b29ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8697e4ed-461e-4544-8137-faf180d111be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "b3633502-a889-43a5-96df-ad92136e1231" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "6426e887-3097-4c19-9340-cd1a76131216" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-059634f9-d09d-4909-87ec-c3bac676b401 req-b05586b2-10bf-4776-9847-7a06569d18cf service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-059634f9-d09d-4909-87ec-c3bac676b401 req-b05586b2-10bf-4776-9847-7a06569d18cf service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-059634f9-d09d-4909-87ec-c3bac676b401 req-b05586b2-10bf-4776-9847-7a06569d18cf service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-059634f9-d09d-4909-87ec-c3bac676b401 req-b05586b2-10bf-4776-9847-7a06569d18cf service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-059634f9-d09d-4909-87ec-c3bac676b401 req-b05586b2-10bf-4776-9847-7a06569d18cf service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:20 user nova-compute[76049]: WARNING nova.compute.manager [req-059634f9-d09d-4909-87ec-c3bac676b401 req-b05586b2-10bf-4776-9847-7a06569d18cf service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state building and task_state spawning.
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:26:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance spawned successfully.
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance spawned successfully.
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d41b7cb-3983-4490-8ead-b6c6788592a1 req-cd2d7a8b-6617-447c-a67f-62b0affe937a service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d41b7cb-3983-4490-8ead-b6c6788592a1 req-cd2d7a8b-6617-447c-a67f-62b0affe937a service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d41b7cb-3983-4490-8ead-b6c6788592a1 req-cd2d7a8b-6617-447c-a67f-62b0affe937a service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5d41b7cb-3983-4490-8ead-b6c6788592a1 req-cd2d7a8b-6617-447c-a67f-62b0affe937a service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-5d41b7cb-3983-4490-8ead-b6c6788592a1 req-cd2d7a8b-6617-447c-a67f-62b0affe937a service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:20 user nova-compute[76049]: WARNING nova.compute.manager [req-5d41b7cb-3983-4490-8ead-b6c6788592a1 req-cd2d7a8b-6617-447c-a67f-62b0affe937a service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received unexpected event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with vm_state building and task_state spawning.
Nov 15 11:26:20 user nova-compute[76049]: INFO nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:26:20 user nova-compute[76049]: INFO nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Took 7.23 seconds to spawn the instance on the hypervisor.
Nov 15 11:26:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:26:20 user nova-compute[76049]: INFO nova.compute.manager [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Took 7.16 seconds to build instance.
Nov 15 11:26:20 user nova-compute[76049]: INFO nova.compute.manager [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Took 8.07 seconds to build instance.
Nov 15 11:26:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-72b5c91d-ad26-4895-9f52-9ddc68be97f5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.272s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.974s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:21 user nova-compute[76049]: INFO nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 15 11:26:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f0a85bd0-3861-420a-9834-c91ebff76deb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.194s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.979s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:21 user nova-compute[76049]: INFO nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 15 11:26:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing instance network info cache due to event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] Acquiring lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] Acquired lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updated VIF entry in instance network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8bdc58e-76b6-47f6-ad79-fdeb672d18d4 req-e7a2c5a5-fc47-48a0-8c8a-24af6c7caa01 service nova] Releasing lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:30 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: b3633502-a889-43a5-96df-ad92136e1231] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:31 user nova-compute[76049]: INFO nova.compute.manager [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Detaching volume d01784e2-4351-42b1-8946-c1a352b56b5b
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: b3633502-a889-43a5-96df-ad92136e1231] Updating instance_info_cache with network_info: [{"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:31 user nova-compute[76049]: INFO nova.virt.block_device [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Attempting to driver detach volume d01784e2-4351-42b1-8946-c1a352b56b5b from mountpoint /dev/vdb
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-b3633502-a889-43a5-96df-ad92136e1231" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: b3633502-a889-43a5-96df-ad92136e1231] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Attempting to detach device vdb from instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:26:31 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:26:31 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:26:31 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:26:31 user nova-compute[76049]:   <serial>d01784e2-4351-42b1-8946-c1a352b56b5b</serial>
Nov 15 11:26:31 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:26:31 user nova-compute[76049]: </disk>
Nov 15 11:26:31 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:26:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully detached device vdb from instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 from the persistent domain config.
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:26:31 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:26:31 user nova-compute[76049]:   <source dev="/dev/sdc"/>
Nov 15 11:26:31 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:26:31 user nova-compute[76049]:   <serial>d01784e2-4351-42b1-8946-c1a352b56b5b</serial>
Nov 15 11:26:31 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:26:31 user nova-compute[76049]: </disk>
Nov 15 11:26:31 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.compute.manager [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing instance network info cache due to event network-changed-195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] Acquiring lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] Acquired lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Refreshing network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updated VIF entry in instance network info cache for port 195816f3-6635-4db5-9eab-aed97c980ce9. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG nova.network.neutron [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [{"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4e05ac4f-cc51-47c2-9a19-0cf53b1e9c9c req-6d5e79c9-5eab-409b-8d51-d90e050b3d0d service nova] Releasing lock "refresh_cache-79b1e190-6f5c-4546-88de-31d8a3ec36b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:26:33 user nova-compute[76049]: INFO nova.compute.claims [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Claim successful on node user
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:26:33 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG nova.policy [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac7d77f50629413bb7b6c9457156af67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0917737287484e2498e2dcf616b8679e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:26:33 user nova-compute[76049]: INFO nova.virt.block_device [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Booting with volume b22cc816-8326-4fe4-9f15-fb71fcd10852 at /dev/vda
Nov 15 11:26:33 user nova-compute[76049]: DEBUG os_brick.utils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6d4193-95d0-4c54-9373-cbfc1d750020]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eea6fd-2b7e-4776-bfa5-234591a72362]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a49f0d-34cf-4a9d-9317-e513413a1799]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e4792-81bb-48c5-8480-191d28aae363]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:26:34 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:26:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[33852464-2357-4c6f-a2d4-6ea19e6a656b]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG os_brick.utils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updating existing volume attachment record: d2af6cb6-1463-473c-adc9-dc2c3590b57a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:26:34 user nova-compute[76049]: DEBUG nova.network.neutron [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Successfully created port: ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Successfully updated port: ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquired lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-changed-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Refreshing instance network info cache due to event network-changed-ebc8de16-4b06-4f6c-af63-452043a5401a. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] Acquiring lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updating instance_info_cache with network_info: [{"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Releasing lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Instance network_info: |[{"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] Acquired lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:35 user nova-compute[76049]: DEBUG nova.network.neutron [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Refreshing network info cache for port ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG nova.network.neutron [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updated VIF entry in instance network info cache for port ebc8de16-4b06-4f6c-af63-452043a5401a. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG nova.network.neutron [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updating instance_info_cache with network_info: [{"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dae60fb3-a126-4ab3-9d7d-b74cbcea44df req-8b0898ec-282e-486d-99af-d1d3cde1d292 service nova] Releasing lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:26:37 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:26:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Creating image(s)
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Ensure instance console log exists: /opt/stack/data/nova/instances/65cf42f2-4fc4-4e88-a78e-5a3babde37ec/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Start _get_guest_xml network_info=[{"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65cf42f2-4fc4-4e88-a78e-5a3babde37ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'b22cc816-8326-4fe4-9f15-fb71fcd10852', 'serial': 'b22cc816-8326-4fe4-9f15-fb71fcd10852'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'd2af6cb6-1463-473c-adc9-dc2c3590b57a', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:39 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:26:39 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:26:39 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:26:39 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df7d3a7-9a0b-4315-aeb7-a7c2bb8c7875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:26:39 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9354b2b2-7dc2-4cda-b923-003ce1000a17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852] added
Nov 15 11:26:39 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9440066-ed78-43e3-b8aa-b88914593854]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce8ff8e-8482-471b-b89b-61f30f431ab0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxYZWrjO {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxYZWrjO" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4578bc04-0ef3-4811-8418-45dfefc81624]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxYZWrjO'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dd19d8-f7d0-45c9-8d5f-6e409873bf34]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea643e9-23a4-4a73-a037-49d3a37e6441]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56193d1-a6c9-441e-92bb-d65119ffcad6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]
Nov 15 11:26:39 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.
Nov 15 11:26:39 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c59148-8256-4920-b084-feae3b5e9022]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc704e3-d72b-4be1-b171-5973853d48e0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:39 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:39 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:39 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c66b0-7f93-460b-b234-678646cb2c67]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:26:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-changed-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Refreshing instance network info cache due to event network-changed-cd95e33b-3cbe-45e4-888d-4d7c476fe725. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] Acquiring lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] Acquired lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Refreshing network info cache for port cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7404MB free_disk=24.865360260009766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23137623832353035', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137623832353035', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-865644559',display_name='tempest-TestVolumeBootPattern-server-865644559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-865644559',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-ndkg0omq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:34Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=65cf42f2-4fc4-4e88-a78e-5a3babde37ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=ebc8de16-4b06-4f6c-af63-452043a5401a,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8de16-4b') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.objects.instance [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'pci_devices' on Instance uuid 65cf42f2-4fc4-4e88-a78e-5a3babde37ec {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:26:40 user nova-compute[76049]:   <uuid>65cf42f2-4fc4-4e88-a78e-5a3babde37ec</uuid>
Nov 15 11:26:40 user nova-compute[76049]:   <name>instance-0000002d</name>
Nov 15 11:26:40 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:26:40 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:26:40 user nova-compute[76049]:   <metadata>
Nov 15 11:26:40 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:26:40 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:26:40 user nova-compute[76049]:       <nova:name>tempest-TestVolumeBootPattern-server-865644559</nova:name>
Nov 15 11:26:40 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:26:39</nova:creationTime>
Nov 15 11:26:40 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:26:40 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:26:40 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:26:40 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:26:40 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:26:40 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:26:40 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:26:40 user nova-compute[76049]:       <nova:owner>
Nov 15 11:26:40 user nova-compute[76049]:         <nova:user uuid="ac7d77f50629413bb7b6c9457156af67">tempest-TestVolumeBootPattern-2118546811-project-member</nova:user>
Nov 15 11:26:40 user nova-compute[76049]:         <nova:project uuid="0917737287484e2498e2dcf616b8679e">tempest-TestVolumeBootPattern-2118546811</nova:project>
Nov 15 11:26:40 user nova-compute[76049]:       </nova:owner>
Nov 15 11:26:40 user nova-compute[76049]:       <nova:ports>
Nov 15 11:26:40 user nova-compute[76049]:         <nova:port uuid="ebc8de16-4b06-4f6c-af63-452043a5401a">
Nov 15 11:26:40 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 11:26:40 user nova-compute[76049]:         </nova:port>
Nov 15 11:26:40 user nova-compute[76049]:       </nova:ports>
Nov 15 11:26:40 user nova-compute[76049]:     </nova:instance>
Nov 15 11:26:40 user nova-compute[76049]:   </metadata>
Nov 15 11:26:40 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:26:40 user nova-compute[76049]:     <system>
Nov 15 11:26:40 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:26:40 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:26:40 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:26:40 user nova-compute[76049]:       <entry name="serial">65cf42f2-4fc4-4e88-a78e-5a3babde37ec</entry>
Nov 15 11:26:40 user nova-compute[76049]:       <entry name="uuid">65cf42f2-4fc4-4e88-a78e-5a3babde37ec</entry>
Nov 15 11:26:40 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:26:40 user nova-compute[76049]:     </system>
Nov 15 11:26:40 user nova-compute[76049]:   </sysinfo>
Nov 15 11:26:40 user nova-compute[76049]:   <os>
Nov 15 11:26:40 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:26:40 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:26:40 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:26:40 user nova-compute[76049]:   </os>
Nov 15 11:26:40 user nova-compute[76049]:   <features>
Nov 15 11:26:40 user nova-compute[76049]:     <acpi/>
Nov 15 11:26:40 user nova-compute[76049]:     <apic/>
Nov 15 11:26:40 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:26:40 user nova-compute[76049]:   </features>
Nov 15 11:26:40 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:26:40 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:26:40 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:26:40 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:26:40 user nova-compute[76049]:   </clock>
Nov 15 11:26:40 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:26:40 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:26:40 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:26:40 user nova-compute[76049]:   </cpu>
Nov 15 11:26:40 user nova-compute[76049]:   <devices>
Nov 15 11:26:40 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:26:40 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:26:40 user nova-compute[76049]:       <source dev="/dev/sdb"/>
Nov 15 11:26:40 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:26:40 user nova-compute[76049]:       <serial>b22cc816-8326-4fe4-9f15-fb71fcd10852</serial>
Nov 15 11:26:40 user nova-compute[76049]:     </disk>
Nov 15 11:26:40 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:26:40 user nova-compute[76049]:       <mac address="fa:16:3e:56:b9:ea"/>
Nov 15 11:26:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:26:40 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:26:40 user nova-compute[76049]:       <target dev="tapebc8de16-4b"/>
Nov 15 11:26:40 user nova-compute[76049]:     </interface>
Nov 15 11:26:40 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:26:40 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/65cf42f2-4fc4-4e88-a78e-5a3babde37ec/console.log" append="off"/>
Nov 15 11:26:40 user nova-compute[76049]:     </serial>
Nov 15 11:26:40 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:26:40 user nova-compute[76049]:     <video>
Nov 15 11:26:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:26:40 user nova-compute[76049]:     </video>
Nov 15 11:26:40 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:26:40 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:26:40 user nova-compute[76049]:     </rng>
Nov 15 11:26:40 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:26:40 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:26:40 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:26:40 user nova-compute[76049]:     </memballoon>
Nov 15 11:26:40 user nova-compute[76049]:   </devices>
Nov 15 11:26:40 user nova-compute[76049]: </domain>
Nov 15 11:26:40 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-865644559',display_name='tempest-TestVolumeBootPattern-server-865644559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-865644559',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-ndkg0omq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:34Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=65cf42f2-4fc4-4e88-a78e-5a3babde37ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=ebc8de16-4b06-4f6c-af63-452043a5401a,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8de16-4b') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG os_vif [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=ebc8de16-4b06-4f6c-af63-452043a5401a,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8de16-4b') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65421067-941a-51ac-8986-41d9c9017f90', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebc8de16-4b, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebc8de16-4b, col_values=(('qos', UUID('a6427569-774d-4357-bc64-e8c89cdefc39')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebc8de16-4b, col_values=(('external_ids', {'iface-id': 'ebc8de16-4b06-4f6c-af63-452043a5401a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:b9:ea', 'vm-uuid': '65cf42f2-4fc4-4e88-a78e-5a3babde37ec'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:40 user nova-compute[76049]: INFO os_vif [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=ebc8de16-4b06-4f6c-af63-452043a5401a,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8de16-4b')
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6426e887-3097-4c19-9340-cd1a76131216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 65cf42f2-4fc4-4e88-a78e-5a3babde37ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:26:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No VIF found with MAC fa:16:3e:56:b9:ea, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Updated VIF entry in instance network info cache for port cd95e33b-3cbe-45e4-888d-4d7c476fe725. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Updating instance_info_cache with network_info: [{"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-cb4304b4-f4ff-41ef-b61b-1c9c52252f9f req-e08430cd-be8e-497e-a2ac-23d949e6ad5b service nova] Releasing lock "refresh_cache-6c9ce91d-18c5-478a-83ae-2f9b374c1416" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:26:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-fbc107a9-b7b9-4045-b9a1-ee5b36f959ea req-683cd111-2afe-4cd7-a9ed-3b6fc33f7d94 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fbc107a9-b7b9-4045-b9a1-ee5b36f959ea req-683cd111-2afe-4cd7-a9ed-3b6fc33f7d94 service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fbc107a9-b7b9-4045-b9a1-ee5b36f959ea req-683cd111-2afe-4cd7-a9ed-3b6fc33f7d94 service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fbc107a9-b7b9-4045-b9a1-ee5b36f959ea req-683cd111-2afe-4cd7-a9ed-3b6fc33f7d94 service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-fbc107a9-b7b9-4045-b9a1-ee5b36f959ea req-683cd111-2afe-4cd7-a9ed-3b6fc33f7d94 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:42 user nova-compute[76049]: WARNING nova.compute.manager [req-fbc107a9-b7b9-4045-b9a1-ee5b36f959ea req-683cd111-2afe-4cd7-a9ed-3b6fc33f7d94 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received unexpected event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with vm_state building and task_state spawning.
Nov 15 11:26:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid 6c9ce91d-18c5-478a-83ae-2f9b374c1416 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:26:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Instance spawned successfully.
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-0f370814-83d9-4bd0-8eca-79346d8dd9d2 req-b17ce147-2d9b-49ca-a8ce-17e0d861ff5f service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0f370814-83d9-4bd0-8eca-79346d8dd9d2 req-b17ce147-2d9b-49ca-a8ce-17e0d861ff5f service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0f370814-83d9-4bd0-8eca-79346d8dd9d2 req-b17ce147-2d9b-49ca-a8ce-17e0d861ff5f service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0f370814-83d9-4bd0-8eca-79346d8dd9d2 req-b17ce147-2d9b-49ca-a8ce-17e0d861ff5f service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-0f370814-83d9-4bd0-8eca-79346d8dd9d2 req-b17ce147-2d9b-49ca-a8ce-17e0d861ff5f service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:44 user nova-compute[76049]: WARNING nova.compute.manager [req-0f370814-83d9-4bd0-8eca-79346d8dd9d2 req-b17ce147-2d9b-49ca-a8ce-17e0d861ff5f service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received unexpected event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with vm_state building and task_state spawning.
Nov 15 11:26:44 user nova-compute[76049]: INFO nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 11:26:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:44 user nova-compute[76049]: INFO nova.compute.manager [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Attaching volume 12f561c3-cc98-47bb-8ce1-3f7b30a19c0d to /dev/vdb
Nov 15 11:26:44 user nova-compute[76049]: DEBUG os_brick.utils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:26:44 user nova-compute[76049]: INFO nova.compute.manager [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Took 11.90 seconds to build instance.
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b494e64-1aaa-4673-b045-11b99f93b3d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-07b493aa-e15b-4202-bc32-226276370245 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.036s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b82d8e-2e74-4217-9c8e-93c24195db1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9172ff11-f2d2-4b7d-a9de-7efccedbd543]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b8e8e-af1b-47ab-a820-e66956a9ebdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:26:45 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:26:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3033d4-25ab-40da-bba3-580e21975e3d]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG os_brick.utils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Updating existing volume attachment record: 39f9d146-08f6-4955-9444-16449d73bbf7 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:26:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhLRdpbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:26:50 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:26:50 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:26:50 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5f42b-8e56-4734-9f79-90e9a758cfe0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:26:50 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[92460686-81eb-4dfb-8e8c-40649cd810bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d] added
Nov 15 11:26:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[065917dc-fbc5-4abc-905e-0edb82a6be84]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4583554-4821-4a1d-a0a2-a63f4e637bd8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhLRdpbs {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhLRdpbs" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[661722c8-71fd-4d89-9520-a2585827b972]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qhLRdpbs'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4421b1d-8286-45cd-af2e-937aeccbdeb9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e69d5-fb60-4586-b88b-f8d1bf90063f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c13fc-1e75-4daa-8731-8792a235896b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260]
Nov 15 11:26:50 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260] successful.
Nov 15 11:26:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec6c8c-dfdf-432e-b80f-0fa5108b4e1b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce338942-7ee7-4b35-983a-0c812afd1b76]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:26:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:50 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:26:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf7e4b7-7f04-4dce-8107-07118015fce2]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhLRdpbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:26:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-changed-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.compute.manager [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Refreshing instance network info cache due to event network-changed-b35c63a9-bd65-4a46-a9bd-87decd1daeb8. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] Acquiring lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] Acquired lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Refreshing network info cache for port b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updated VIF entry in instance network info cache for port b35c63a9-bd65-4a46-a9bd-87decd1daeb8. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.network.neutron [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-19eab761-6b4f-42e2-9be2-0a3856f8c39b req-ba52baea-bb3c-41cd-a7ed-75f8cb2006f1 service nova] Releasing lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:51 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 is timed out.
Nov 15 11:26:51 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully detached device vdb from instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 from the live domain config.
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xphDuXbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:26:51 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23039373737626563', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039373737626563', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.114s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid 6c9ce91d-18c5-478a-83ae-2f9b374c1416 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bcedde-b697-4bc2-a6b2-e3045b1d21fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:26:51 user nova-compute[76049]: No targets found.
Nov 15 11:26:51 user nova-compute[76049]: iSNS:
Nov 15 11:26:51 user nova-compute[76049]: No targets found.
Nov 15 11:26:51 user nova-compute[76049]: STATIC:
Nov 15 11:26:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:26:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:26:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b
Nov 15 11:26:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d
Nov 15 11:26:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:26:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:51 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:26:51 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:51 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:51 user nova-compute[76049]: FIRMWARE:
Nov 15 11:26:51 user nova-compute[76049]: No targets found.
Nov 15 11:26:51 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:26:51 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:26:51 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:26:51 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:26:51 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:26:51 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:26:51 user nova-compute[76049]:   <serial>12f561c3-cc98-47bb-8ce1-3f7b30a19c0d</serial>
Nov 15 11:26:51 user nova-compute[76049]: </disk>
Nov 15 11:26:51 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c9511-bf59-4966-b28b-addf7db105b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab7ebf6-59c7-4b8d-b9b3-c4500c2daa07]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:26:51 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:51 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:26:51 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284611900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6b971c-cf2c-48cf-bbf4-f2d45f601aad]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd1417-2331-455d-a892-7515163dd61e]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:26:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cc4cef-baac-4237-b8aa-ef1819f0bd43]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b70c3fd-82b8-4729-a7ec-54a8a77a1e31]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d297ee-bbd7-4fde-a22d-7e0d8c1cc457]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d045b838-5d51-436b-a49d-bdadfb8eca27]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260]
Nov 15 11:26:52 user nova-compute[76049]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b, portal: 172.16.0.220,3260] successful.
Nov 15 11:26:52 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d01784e2-4351-42b1-8946-c1a352b56b5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a127503-c75d-4f1f-b6c4-69c12d0615a9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] <== disconnect_volume: return (498ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No VIF found with MAC fa:16:3e:67:6d:fa, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:26:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f99abbf-65d2-4384-aa2a-3f18c87162b8 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.700s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Stashing vm_state: active {{(pid=76049) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.compute.manager [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-changed-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.compute.manager [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Refreshing instance network info cache due to event network-changed-3f38a8ea-3588-47c3-a10d-7f4787fe629d. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] Acquiring lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] Acquired lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.network.neutron [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Refreshing network info cache for port 3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.objects.instance [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'flavor' on Instance uuid 79b1e190-6f5c-4546-88de-31d8a3ec36b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-93594161-c12c-4956-be1e-ea016767b219 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.121s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:26:53 user nova-compute[76049]: INFO nova.compute.claims [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Claim successful on node user
Nov 15 11:26:53 user nova-compute[76049]: INFO nova.compute.resource_tracker [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating resource usage from migration 19ccb52c-de96-449d-994e-d15112a67546
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.network.neutron [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updated VIF entry in instance network info cache for port 3f38a8ea-3588-47c3-a10d-7f4787fe629d. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.network.neutron [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating instance_info_cache with network_info: [{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a67f25ae-0ca5-4365-bcbe-3d73a89d27ba req-e0331590-413a-4cc1-9818-148883033256 service nova] Releasing lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.501s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:53 user nova-compute[76049]: INFO nova.compute.manager [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Migrating
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquired lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG nova.network.neutron [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:54 user nova-compute[76049]: INFO nova.compute.manager [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Detaching volume 12f561c3-cc98-47bb-8ce1-3f7b30a19c0d
Nov 15 11:26:54 user nova-compute[76049]: INFO nova.virt.block_device [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Attempting to driver detach volume 12f561c3-cc98-47bb-8ce1-3f7b30a19c0d from mountpoint /dev/vdb
Nov 15 11:26:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Attempting to detach device vdb from instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:26:54 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:26:54 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:26:54 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:26:54 user nova-compute[76049]:   <serial>12f561c3-cc98-47bb-8ce1-3f7b30a19c0d</serial>
Nov 15 11:26:54 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:26:54 user nova-compute[76049]: </disk>
Nov 15 11:26:54 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:26:54 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully detached device vdb from instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 from the persistent domain config.
Nov 15 11:26:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:26:54 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:26:54 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:26:54 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:26:54 user nova-compute[76049]:   <serial>12f561c3-cc98-47bb-8ce1-3f7b30a19c0d</serial>
Nov 15 11:26:54 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:26:54 user nova-compute[76049]: </disk>
Nov 15 11:26:54 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating instance_info_cache with network_info: [{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Releasing lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Starting migrate_disk_and_power_off {{(pid=76049) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:55 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance destroyed successfully.
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1578483471',display_name='tempest-ServerActionsTestOtherA-server-1578483471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1578483471',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-mjy54lb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=6426e887-3097-4c19-9340-cd1a76131216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1811445490-network", "vif_mac": "fa:16:3e:a2:84:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1811445490-network", "vif_mac": "fa:16:3e:a2:84:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_vif [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f38a8ea-35, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=241b0aeb-50b6-4f91-a396-0d8995374e34) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:26:55 user nova-compute[76049]: INFO os_vif [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35')
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:26:55 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7050f9b0-0397-4650-bf0f-45d6fc1c7986]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:26:55 user nova-compute[76049]: No targets found.
Nov 15 11:26:55 user nova-compute[76049]: iSNS:
Nov 15 11:26:55 user nova-compute[76049]: No targets found.
Nov 15 11:26:55 user nova-compute[76049]: STATIC:
Nov 15 11:26:55 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:26:55 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:55 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:55 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:26:55 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:55 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:55 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d
Nov 15 11:26:55 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:55 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:55 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:26:55 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:55 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:55 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:26:55 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:26:55 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:26:55 user nova-compute[76049]: FIRMWARE:
Nov 15 11:26:55 user nova-compute[76049]: No targets found.
Nov 15 11:26:55 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:26:55 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:26:55 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb7b080-9d48-40c7-a032-6faa843ee406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780e853-0e8d-4f80-bb00-86de3f552a98]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:26:55 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:26:55 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:26:55 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842b93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c'): ({'sdg'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Removing single pathed devices sdg {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[10365b37-d22c-4551-96e3-433402b80abd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31e50e-38ee-43a8-9060-e98de762b3e5]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flushing IO for device /dev/sdg {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-unplugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-unplugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:55 user nova-compute[76049]: WARNING nova.compute.manager [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received unexpected event network-vif-unplugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with vm_state active and task_state resize_migrating.
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:26:55 user nova-compute[76049]: WARNING nova.compute.manager [req-1900f710-1a52-44dd-82c9-447c0d364e90 req-68975db3-4d18-4203-b36d-fbff55cb3287 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received unexpected event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with vm_state active and task_state resize_migrating.
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f71df9-ffd1-45b6-9ac0-0807052a3970]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[194618ef-3aff-4a10-a9e7-1d26c428144a]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6198589e-74305efa42634936', '/dev/disk/by-id/scsi-23734333035656661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6198589e') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aaa766-5ffa-4395-bb7d-630ad7d19d06]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bf179d-34d2-403c-87e9-d7fd157c9f62]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c95164-d6ec-4284-8425-aa105f649a0d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]
Nov 15 11:26:55 user nova-compute[76049]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.
Nov 15 11:26:55 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7155f0fe-1bbe-475c-a273-5914ae1d1590]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== disconnect_volume: return (330ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:26:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:26:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Port 3f38a8ea-3588-47c3-a10d-7f4787fe629d binding to destination host user is already ACTIVE {{(pid=76049) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 11:26:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:26:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:26:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:26:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:26:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquired lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:26:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating instance_info_cache with network_info: [{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Releasing lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG os_brick.utils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3edbfa3-9d25-445a-8f4c-ec179c52f4cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e8b128-b349-41d4-84ce-dee0b431d481]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1d8c5-0679-4d1f-9476-f7ee205c6e71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b938d7da-8337-4db8-aae0-dc5c09361cc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:26:57 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:26:57 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c7444c-cc69-4d16-9dcc-4e34c7337813]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:26:57 user nova-compute[76049]: DEBUG os_brick.utils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:26:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Starting finish_migration {{(pid=76049) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:27:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Creating image(s)
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Ensure instance console log exists: /opt/stack/data/nova/instances/6426e887-3097-4c19-9340-cd1a76131216/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Start _get_guest_xml network_info=[{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1811445490-network", "vif_mac": "fa:16:3e:a2:84:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6426e887-3097-4c19-9340-cd1a76131216', 'attached_at': '2023-11-15T11:27:02.000000', 'detached_at': '', 'volume_id': 'c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'serial': 'c64321a7-fb06-4edb-ab36-3478e8c76d7c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'f585b7e9-13ee-4930-9819-ecd80e8cd6d6', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:27:02 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:27:02 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:27:02 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:02 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:02 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fa78dd-943a-4529-9d4d-f89118c870ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:27:02 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e2f625-19d3-49a3-90a0-05d2125a2ccd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c] added
Nov 15 11:27:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c4c03-c6cb-4424-9196-c208b5701b61]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58b6d0d-34ac-44a1-81c7-f6392f52fb9d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVyTKng {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVyTKng" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d8a34a-7cbf-4fcd-bea2-5952a9649ef9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZVyTKng'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd31b448-4a1b-45d1-8d75-9537d73b0003]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea8e966-c43c-490a-ad57-75c76db3f74b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:27:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:27:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd3ac9f-b4f4-41f9-8e0d-e28f52c5b677]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]
Nov 15 11:27:02 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.
Nov 15 11:27:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[158bb7f2-fd68-4157-9c93-68140ff33e18]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f951a19-fa71-46fe-8fef-9de62a0226ca]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:27:02 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:02 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[789ca90d-e930-4836-aa9a-d96f0a99a067]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:27:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23734333035656661', 'path': '/dev/sdc'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734333035656661', 'path': '/dev/sdc'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1578483471',display_name='tempest-ServerActionsTestOtherA-server-1578483471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1578483471',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-mjy54lb4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=6426e887-3097-4c19-9340-cd1a76131216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1811445490-network", "vif_mac": "fa:16:3e:a2:84:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1811445490-network", "vif_mac": "fa:16:3e:a2:84:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:27:03 user nova-compute[76049]:   <uuid>6426e887-3097-4c19-9340-cd1a76131216</uuid>
Nov 15 11:27:03 user nova-compute[76049]:   <name>instance-00000029</name>
Nov 15 11:27:03 user nova-compute[76049]:   <memory>2097152</memory>
Nov 15 11:27:03 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:27:03 user nova-compute[76049]:   <metadata>
Nov 15 11:27:03 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:27:03 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:27:03 user nova-compute[76049]:       <nova:name>tempest-ServerActionsTestOtherA-server-1578483471</nova:name>
Nov 15 11:27:03 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:27:02</nova:creationTime>
Nov 15 11:27:03 user nova-compute[76049]:       <nova:flavor name="m1.small">
Nov 15 11:27:03 user nova-compute[76049]:         <nova:memory>2048</nova:memory>
Nov 15 11:27:03 user nova-compute[76049]:         <nova:disk>20</nova:disk>
Nov 15 11:27:03 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:27:03 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:27:03 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:27:03 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:27:03 user nova-compute[76049]:       <nova:owner>
Nov 15 11:27:03 user nova-compute[76049]:         <nova:user uuid="c548eac583644342a905b89ee8fc4b1a">tempest-ServerActionsTestOtherA-278593450-project-member</nova:user>
Nov 15 11:27:03 user nova-compute[76049]:         <nova:project uuid="a61718ae918a495eadf79664d2ea66c6">tempest-ServerActionsTestOtherA-278593450</nova:project>
Nov 15 11:27:03 user nova-compute[76049]:       </nova:owner>
Nov 15 11:27:03 user nova-compute[76049]:       <nova:ports>
Nov 15 11:27:03 user nova-compute[76049]:         <nova:port uuid="3f38a8ea-3588-47c3-a10d-7f4787fe629d">
Nov 15 11:27:03 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 11:27:03 user nova-compute[76049]:         </nova:port>
Nov 15 11:27:03 user nova-compute[76049]:       </nova:ports>
Nov 15 11:27:03 user nova-compute[76049]:     </nova:instance>
Nov 15 11:27:03 user nova-compute[76049]:   </metadata>
Nov 15 11:27:03 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:27:03 user nova-compute[76049]:     <system>
Nov 15 11:27:03 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:27:03 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:27:03 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:27:03 user nova-compute[76049]:       <entry name="serial">6426e887-3097-4c19-9340-cd1a76131216</entry>
Nov 15 11:27:03 user nova-compute[76049]:       <entry name="uuid">6426e887-3097-4c19-9340-cd1a76131216</entry>
Nov 15 11:27:03 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:27:03 user nova-compute[76049]:     </system>
Nov 15 11:27:03 user nova-compute[76049]:   </sysinfo>
Nov 15 11:27:03 user nova-compute[76049]:   <os>
Nov 15 11:27:03 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:27:03 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:27:03 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:27:03 user nova-compute[76049]:   </os>
Nov 15 11:27:03 user nova-compute[76049]:   <features>
Nov 15 11:27:03 user nova-compute[76049]:     <acpi/>
Nov 15 11:27:03 user nova-compute[76049]:     <apic/>
Nov 15 11:27:03 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:27:03 user nova-compute[76049]:   </features>
Nov 15 11:27:03 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:27:03 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:27:03 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:27:03 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:27:03 user nova-compute[76049]:   </clock>
Nov 15 11:27:03 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:27:03 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:27:03 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:27:03 user nova-compute[76049]:   </cpu>
Nov 15 11:27:03 user nova-compute[76049]:   <devices>
Nov 15 11:27:03 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:27:03 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:27:03 user nova-compute[76049]:       <source dev="/dev/sdc"/>
Nov 15 11:27:03 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:27:03 user nova-compute[76049]:       <serial>c64321a7-fb06-4edb-ab36-3478e8c76d7c</serial>
Nov 15 11:27:03 user nova-compute[76049]:     </disk>
Nov 15 11:27:03 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:27:03 user nova-compute[76049]:       <mac address="fa:16:3e:a2:84:1d"/>
Nov 15 11:27:03 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:27:03 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:27:03 user nova-compute[76049]:       <target dev="tap3f38a8ea-35"/>
Nov 15 11:27:03 user nova-compute[76049]:     </interface>
Nov 15 11:27:03 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:27:03 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6426e887-3097-4c19-9340-cd1a76131216/console.log" append="off"/>
Nov 15 11:27:03 user nova-compute[76049]:     </serial>
Nov 15 11:27:03 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:27:03 user nova-compute[76049]:     <video>
Nov 15 11:27:03 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:27:03 user nova-compute[76049]:     </video>
Nov 15 11:27:03 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:27:03 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:27:03 user nova-compute[76049]:     </rng>
Nov 15 11:27:03 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:27:03 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:27:03 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:27:03 user nova-compute[76049]:     </memballoon>
Nov 15 11:27:03 user nova-compute[76049]:   </devices>
Nov 15 11:27:03 user nova-compute[76049]: </domain>
Nov 15 11:27:03 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1578483471',display_name='tempest-ServerActionsTestOtherA-server-1578483471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1578483471',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-mjy54lb4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=6426e887-3097-4c19-9340-cd1a76131216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1811445490-network", "vif_mac": "fa:16:3e:a2:84:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1811445490-network", "vif_mac": "fa:16:3e:a2:84:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG os_vif [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2034931f-f472-509d-9f2c-5b0152bb2e9d', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f38a8ea-35, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f38a8ea-35, col_values=(('qos', UUID('e89a8db5-10a3-4d6f-8ae4-c37489c28233')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f38a8ea-35, col_values=(('external_ids', {'iface-id': '3f38a8ea-3588-47c3-a10d-7f4787fe629d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:84:1d', 'vm-uuid': '6426e887-3097-4c19-9340-cd1a76131216'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:03 user nova-compute[76049]: INFO os_vif [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35')
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:27:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] No VIF found with MAC fa:16:3e:a2:84:1d, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:27:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-77495456-5eea-49f5-b40a-69b7228c30f7 req-c93b87d0-1223-4daa-be55-5b0a4c342334 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77495456-5eea-49f5-b40a-69b7228c30f7 req-c93b87d0-1223-4daa-be55-5b0a4c342334 service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77495456-5eea-49f5-b40a-69b7228c30f7 req-c93b87d0-1223-4daa-be55-5b0a4c342334 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77495456-5eea-49f5-b40a-69b7228c30f7 req-c93b87d0-1223-4daa-be55-5b0a4c342334 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:05 user nova-compute[76049]: DEBUG nova.compute.manager [req-77495456-5eea-49f5-b40a-69b7228c30f7 req-c93b87d0-1223-4daa-be55-5b0a4c342334 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:05 user nova-compute[76049]: WARNING nova.compute.manager [req-77495456-5eea-49f5-b40a-69b7228c30f7 req-c93b87d0-1223-4daa-be55-5b0a4c342334 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received unexpected event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with vm_state active and task_state resize_finish.
Nov 15 11:27:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:27:06 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance running successfully.
Nov 15 11:27:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Failed to set time: agent not configured {{(pid=76049) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 11:27:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-375d2162-eb2b-4090-9553-68439b1f878b tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] finish_migration finished successfully. {{(pid=76049) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 11:27:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-eb150235-791d-41b6-a9f5-71393a241402 req-77c605a8-d17e-4133-800a-46e080be8669 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eb150235-791d-41b6-a9f5-71393a241402 req-77c605a8-d17e-4133-800a-46e080be8669 service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eb150235-791d-41b6-a9f5-71393a241402 req-77c605a8-d17e-4133-800a-46e080be8669 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-eb150235-791d-41b6-a9f5-71393a241402 req-77c605a8-d17e-4133-800a-46e080be8669 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:07 user nova-compute[76049]: DEBUG nova.compute.manager [req-eb150235-791d-41b6-a9f5-71393a241402 req-77c605a8-d17e-4133-800a-46e080be8669 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:07 user nova-compute[76049]: WARNING nova.compute.manager [req-eb150235-791d-41b6-a9f5-71393a241402 req-77c605a8-d17e-4133-800a-46e080be8669 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received unexpected event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with vm_state resized and task_state None.
Nov 15 11:27:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-changed-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Refreshing instance network info cache due to event network-changed-677b633e-c8cd-403f-81f2-a8d11f695029. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:27:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] Acquiring lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:27:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] Acquired lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:27:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Refreshing network info cache for port 677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:27:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updated VIF entry in instance network info cache for port 677b633e-c8cd-403f-81f2-a8d11f695029. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:27:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updating instance_info_cache with network_info: [{"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:27:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-61e2021b-f11b-4729-86e4-d7e422201a10 req-1ddc0c98-a1c9-423d-a4dd-adda810825b2 service nova] Releasing lock "refresh_cache-d8ce85ec-1a8b-4231-80b7-dd7ce090f181" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG nova.objects.instance [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:13 user nova-compute[76049]: INFO nova.compute.manager [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Attaching volume 673c0dc0-930b-4a4e-96ab-7bab7e6c6080 to /dev/vdb
Nov 15 11:27:13 user nova-compute[76049]: DEBUG os_brick.utils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bdafac-e391-44ad-a1e6-e02de687fa0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ede400c-d54f-496b-af42-e793cf261774]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3bde5b-06bf-4a50-89d2-7b91fe39e442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b239e4f-43a2-4396-adb2-3d0aafb2a03a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:27:13 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:27:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9acd230-bff1-4167-b928-979747d818d4]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG os_brick.utils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:27:13 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updating existing volume attachment record: 4ad7bcdd-c317-4db9-9279-03732a16ff9e {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:27:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 is timed out.
Nov 15 11:27:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully detached device vdb from instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 from the live domain config.
Nov 15 11:27:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhLRdpbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:27:14 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[918febcf-21aa-4fbd-a8c0-f046b577d9c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:27:14 user nova-compute[76049]: No targets found.
Nov 15 11:27:14 user nova-compute[76049]: iSNS:
Nov 15 11:27:14 user nova-compute[76049]: No targets found.
Nov 15 11:27:14 user nova-compute[76049]: STATIC:
Nov 15 11:27:14 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:27:14 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:14 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:14 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:27:14 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:14 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:14 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d
Nov 15 11:27:14 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:14 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:14 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:27:14 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:14 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:14 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:27:14 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:14 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:14 user nova-compute[76049]: FIRMWARE:
Nov 15 11:27:14 user nova-compute[76049]: No targets found.
Nov 15 11:27:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:27:14 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:27:14 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1189980e-8e26-4eb7-b8ab-7071d37516c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[697fdcc3-aef4-4c58-a2fa-6d1a2c96600f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d (non-flash)
Nov 15 11:27:14 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6260608430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf95c9-4a72-41fc-8f8d-26cfc2e02a11]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4e0bd7-7947-4ca4-ad7a-1155268080fe]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d5187-f9ed-4cf3-9d05-6b6dbd889d22]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4a1265-b741-40eb-a185-978de32fd038]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2bd4eb-75d0-4736-8c41-8f731d537112]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b132c6c-c50e-4339-a373-4e8d5ec97122]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260]
Nov 15 11:27:14 user nova-compute[76049]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d, portal: 172.16.0.220,3260] successful.
Nov 15 11:27:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12f561c3-cc98-47bb-8ce1-3f7b30a19c0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[88772d87-43fd-443b-90b1-ded23f55d893]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== disconnect_volume: return (335ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:27:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:27:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:18 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid 6c9ce91d-18c5-478a-83ae-2f9b374c1416 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a92137af-aa92-4f93-9638-ebf7c0f44963 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.883s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svYTpVBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:27:19 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:19 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:19 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6886dd14-5503-4abd-8395-3e49c3dccaba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:27:19 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a2d0db-efc7-452a-b2a8-0fac255958fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080] added
Nov 15 11:27:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94464eb-d461-4239-82a9-4d1b284a5340]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2b094-1b10-4d8e-b2a0-cf4a5ad928d1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svYTpVBd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svYTpVBd" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f618787-03e7-44b3-b0e3-3a64982d555c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'svYTpVBd'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcae7be1-2dd6-478a-b98c-fd778daafed7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0093e4a8-2c8b-4d74-a807-3e76c77185c6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a24041-cf6e-48c9-baa1-18e556b0513e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260]
Nov 15 11:27:19 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260] successful.
Nov 15 11:27:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[24951270-ac7b-43dd-951f-16f1d55eb709]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[134475d8-6e8b-41b3-b59c-eb3b3b5931fa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:19 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc65d24-566d-49de-8781-d1512b963806]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:27:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svYTpVBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23464336464356233', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464336464356233', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG nova.objects.instance [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:27:20 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:27:20 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:27:20 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:27:20 user nova-compute[76049]:   <serial>673c0dc0-930b-4a4e-96ab-7bab7e6c6080</serial>
Nov 15 11:27:20 user nova-compute[76049]: </disk>
Nov 15 11:27:20 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No VIF found with MAC fa:16:3e:e2:33:3b, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:27:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-97e8cef7-e0f6-46d2-8b75-7b2ff1f478d4 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.450s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:23 user nova-compute[76049]: INFO nova.compute.manager [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Terminating instance
Nov 15 11:27:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-3d74e4e8-ddd4-4222-adf0-89e038b3202e req-ff4af7f3-7a18-4027-99a9-ae00bf248674 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-unplugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3d74e4e8-ddd4-4222-adf0-89e038b3202e req-ff4af7f3-7a18-4027-99a9-ae00bf248674 service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3d74e4e8-ddd4-4222-adf0-89e038b3202e req-ff4af7f3-7a18-4027-99a9-ae00bf248674 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3d74e4e8-ddd4-4222-adf0-89e038b3202e req-ff4af7f3-7a18-4027-99a9-ae00bf248674 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-3d74e4e8-ddd4-4222-adf0-89e038b3202e req-ff4af7f3-7a18-4027-99a9-ae00bf248674 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-unplugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-3d74e4e8-ddd4-4222-adf0-89e038b3202e req-ff4af7f3-7a18-4027-99a9-ae00bf248674 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-unplugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:27:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Instance destroyed successfully.
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.objects.instance [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lazy-loading 'resources' on Instance uuid 79b1e190-6f5c-4546-88de-31d8a3ec36b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1000412488',display_name='tempest-TestMinimumBasicScenario-server-1000412488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1000412488',id=36,image_ref='b88b823c-45c9-4774-9fb6-a13081db84a9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlm9Tt5GzFw4iBJs2uP/hpIc9eMYli92hLiYI156oq9dgItF1s+j7mA4Gvl0ZetRv1EWrQ2zlkt5fIBEbxwrWlFlLVPCrgNFm/lgbOGTSVT/4B+qQmcNEMfPh+6/s3QJQ==',key_name='tempest-TestMinimumBasicScenario-31455806',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:22:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78d017cbd24f46a9b371b9ba33dd9abb',ramdisk_id='',reservation_id='r-1i0qb9uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b88b823c-45c9-4774-9fb6-a13081db84a9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-739422793',owner_user_name='tempest-TestMinimumBasicScenario-739422793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:24:45Z,user_data=None,user_id='9846cdf834fe438e822035561c81d2d8',uuid=79b1e190-6f5c-4546-88de-31d8a3ec36b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converting VIF {"id": "195816f3-6635-4db5-9eab-aed97c980ce9", "address": "fa:16:3e:39:b7:82", "network": {"id": "9105fbc1-f219-476d-8c56-7724d2085252", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2076108590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78d017cbd24f46a9b371b9ba33dd9abb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195816f3-66", "ovs_interfaceid": "195816f3-6635-4db5-9eab-aed97c980ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:b7:82,bridge_name='br-int',has_traffic_filtering=True,id=195816f3-6635-4db5-9eab-aed97c980ce9,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195816f3-66') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG os_vif [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:b7:82,bridge_name='br-int',has_traffic_filtering=True,id=195816f3-6635-4db5-9eab-aed97c980ce9,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195816f3-66') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195816f3-66, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e1cc87f-00ca-43b2-9b95-359f239acace) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:24 user nova-compute[76049]: INFO os_vif [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:b7:82,bridge_name='br-int',has_traffic_filtering=True,id=195816f3-6635-4db5-9eab-aed97c980ce9,network=Network(9105fbc1-f219-476d-8c56-7724d2085252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195816f3-66')
Nov 15 11:27:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Deleting instance files /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9_del
Nov 15 11:27:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Deletion of /opt/stack/data/nova/instances/79b1e190-6f5c-4546-88de-31d8a3ec36b9_del complete
Nov 15 11:27:24 user nova-compute[76049]: INFO nova.compute.manager [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:24 user nova-compute[76049]: INFO nova.compute.manager [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Attaching volume 1be40bc3-1744-491b-b55b-b997f8b7753f to /dev/vdc
Nov 15 11:27:24 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Took 0.50 seconds to deallocate network for instance.
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-234e0b46-a093-48a8-bf66-8380567e0bd6 req-fb917bd6-88c3-4819-86e7-edf5a733c3ba service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-deleted-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:24 user nova-compute[76049]: INFO nova.compute.manager [req-234e0b46-a093-48a8-bf66-8380567e0bd6 req-fb917bd6-88c3-4819-86e7-edf5a733c3ba service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Neutron deleted interface 195816f3-6635-4db5-9eab-aed97c980ce9; detaching it from the instance and deleting it from the info cache
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-234e0b46-a093-48a8-bf66-8380567e0bd6 req-fb917bd6-88c3-4819-86e7-edf5a733c3ba service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:27:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-234e0b46-a093-48a8-bf66-8380567e0bd6 req-fb917bd6-88c3-4819-86e7-edf5a733c3ba service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Detach interface failed, port_id=195816f3-6635-4db5-9eab-aed97c980ce9, reason: Instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG os_brick.utils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca3aca9-1721-44ad-ba76-04f72b37acf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[846384b8-166b-4d70-8c68-f01a66204654]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a13f9c-e7e1-4a28-8221-8018c1bd8441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fef9b7e-2882-42d7-bedb-705662f3d289]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:27:25 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec5b3e8-efcf-4780-980c-21a272835ee6]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG os_brick.utils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updating existing volume attachment record: a66b5b1b-8413-4bef-abe3-6a5ce15f0c35 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:25 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Deleted allocations for instance 79b1e190-6f5c-4546-88de-31d8a3ec36b9
Nov 15 11:27:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-8d72d350-aa20-4c0d-8d6b-58308149d282 tempest-TestMinimumBasicScenario-739422793 tempest-TestMinimumBasicScenario-739422793-project-member] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.966s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5554b15-9fd3-41a7-9668-23ebc37f2140 req-0fa93dd6-1ce6-4201-97d9-b241ac925825 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5554b15-9fd3-41a7-9668-23ebc37f2140 req-0fa93dd6-1ce6-4201-97d9-b241ac925825 service nova] Acquiring lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5554b15-9fd3-41a7-9668-23ebc37f2140 req-0fa93dd6-1ce6-4201-97d9-b241ac925825 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b5554b15-9fd3-41a7-9668-23ebc37f2140 req-0fa93dd6-1ce6-4201-97d9-b241ac925825 service nova] Lock "79b1e190-6f5c-4546-88de-31d8a3ec36b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:26 user nova-compute[76049]: DEBUG nova.compute.manager [req-b5554b15-9fd3-41a7-9668-23ebc37f2140 req-0fa93dd6-1ce6-4201-97d9-b241ac925825 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] No waiting events found dispatching network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:26 user nova-compute[76049]: WARNING nova.compute.manager [req-b5554b15-9fd3-41a7-9668-23ebc37f2140 req-0fa93dd6-1ce6-4201-97d9-b241ac925825 service nova] [instance: 79b1e190-6f5c-4546-88de-31d8a3ec36b9] Received unexpected event network-vif-plugged-195816f3-6635-4db5-9eab-aed97c980ce9 for instance with vm_state deleted and task_state None.
Nov 15 11:27:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzInkwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:27:30 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:30 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:30 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75723b4-52a7-4b83-8be6-d8623c87ae38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:27:30 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd514910-43b1-481c-b0dc-ade443b12d9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f] added
Nov 15 11:27:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90477f5-9dbd-486f-ae27-0b91024d6c2c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b89e9b-3033-473b-9b9a-544a0612f899]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbzInkwt {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbzInkwt" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c222ac-c601-4cf8-9967-3af1df1923e1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbzInkwt'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2beb999-b58a-4903-a864-a89bdbbd87c8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2117ee46-077b-46a3-93d0-19d5b8db0486]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d37b7-67b8-4b06-91ff-5d1ccb059be6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260]
Nov 15 11:27:30 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260] successful.
Nov 15 11:27:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8ca443-aebc-4058-97ce-cd8c561ac227]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5354b50f-6b98-43b8-a8fb-12cc3a8a7878]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)
Nov 15 11:27:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:30 user nova-compute[76049]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)
Nov 15 11:27:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] HCTL ('38', '-', '-', 0) found on session 58 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7417170-34f3-402e-a4fc-bf258fa50645]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Searching for a device in session 58 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:27:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzInkwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26432396135633538', 'path': '/dev/sdg'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432396135633538', 'path': '/dev/sdg'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:27:31 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:27:31 user nova-compute[76049]:   <source dev="/dev/sdg"/>
Nov 15 11:27:31 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:27:31 user nova-compute[76049]:   <serial>1be40bc3-1744-491b-b55b-b997f8b7753f</serial>
Nov 15 11:27:31 user nova-compute[76049]: </disk>
Nov 15 11:27:31 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:27:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] No VIF found with MAC fa:16:3e:e2:33:3b, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ed566547-994b-400c-8db6-388c82362615 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.073s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:27:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:33 user nova-compute[76049]: INFO nova.compute.manager [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Detaching volume 673c0dc0-930b-4a4e-96ab-7bab7e6c6080
Nov 15 11:27:33 user nova-compute[76049]: INFO nova.virt.block_device [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Attempting to driver detach volume 673c0dc0-930b-4a4e-96ab-7bab7e6c6080 from mountpoint /dev/vdb
Nov 15 11:27:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Attempting to detach device vdb from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:27:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:27:33 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:27:33 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:27:33 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:27:33 user nova-compute[76049]:   <serial>673c0dc0-930b-4a4e-96ab-7bab7e6c6080</serial>
Nov 15 11:27:33 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:27:33 user nova-compute[76049]: </disk>
Nov 15 11:27:33 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:27:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:33 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully detached device vdb from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the persistent domain config.
Nov 15 11:27:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:27:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:27:33 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:27:33 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:27:33 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:27:33 user nova-compute[76049]:   <serial>673c0dc0-930b-4a4e-96ab-7bab7e6c6080</serial>
Nov 15 11:27:33 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:27:33 user nova-compute[76049]: </disk>
Nov 15 11:27:33 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:27:33 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:27:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:36 user nova-compute[76049]: INFO nova.compute.manager [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Unrescuing
Nov 15 11:27:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:27:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquired lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:27:36 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG nova.network.neutron [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Updating instance_info_cache with network_info: [{"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Releasing lock "refresh_cache-7220132d-4ce3-4dfb-b119-4bc6c163fcd8" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'flavor' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-f72e0eb3-9e53-4ee4-a8cc-38b284ff8233 req-174ce6b5-1362-4925-bf28-d9a87deb03b1 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f72e0eb3-9e53-4ee4-a8cc-38b284ff8233 req-174ce6b5-1362-4925-bf28-d9a87deb03b1 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f72e0eb3-9e53-4ee4-a8cc-38b284ff8233 req-174ce6b5-1362-4925-bf28-d9a87deb03b1 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f72e0eb3-9e53-4ee4-a8cc-38b284ff8233 req-174ce6b5-1362-4925-bf28-d9a87deb03b1 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG nova.compute.manager [req-f72e0eb3-9e53-4ee4-a8cc-38b284ff8233 req-174ce6b5-1362-4925-bf28-d9a87deb03b1 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:37 user nova-compute[76049]: WARNING nova.compute.manager [req-f72e0eb3-9e53-4ee4-a8cc-38b284ff8233 req-174ce6b5-1362-4925-bf28-d9a87deb03b1 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:27:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:37 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance destroyed successfully.
Nov 15 11:27:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:38 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:39 user nova-compute[76049]: WARNING nova.compute.manager [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:27:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:39 user nova-compute[76049]: WARNING nova.compute.manager [req-b47e1d32-4564-4fc0-81a2-57f88bbcdbcf req-e30e401b-8e54-44c1-b181-816dc3e2f414 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:27:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c60b7dd3-f8fa-4062-baa8-464115c20af0 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-66c9cc9c-23e0-4874-b58a-85c73db5bb3c req-3ba21fbd-e898-4288-817b-176a7dd7d2d8 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-66c9cc9c-23e0-4874-b58a-85c73db5bb3c req-3ba21fbd-e898-4288-817b-176a7dd7d2d8 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-66c9cc9c-23e0-4874-b58a-85c73db5bb3c req-3ba21fbd-e898-4288-817b-176a7dd7d2d8 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-66c9cc9c-23e0-4874-b58a-85c73db5bb3c req-3ba21fbd-e898-4288-817b-176a7dd7d2d8 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-66c9cc9c-23e0-4874-b58a-85c73db5bb3c req-3ba21fbd-e898-4288-817b-176a7dd7d2d8 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:41 user nova-compute[76049]: WARNING nova.compute.manager [req-66c9cc9c-23e0-4874-b58a-85c73db5bb3c req-3ba21fbd-e898-4288-817b-176a7dd7d2d8 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state active and task_state None.
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:27:42 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:27:42 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=24.87714385986328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Applying migration context for instance 6426e887-3097-4c19-9340-cd1a76131216 as it has an incoming, in-progress migration 19ccb52c-de96-449d-994e-d15112a67546. Migration status is finished {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 11:27:42 user nova-compute[76049]: INFO nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating resource usage from migration 19ccb52c-de96-449d-994e-d15112a67546
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 65cf42f2-4fc4-4e88-a78e-5a3babde37ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Migration 19ccb52c-de96-449d-994e-d15112a67546 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6426e887-3097-4c19-9340-cd1a76131216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:27:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:27:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:43 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:27:43 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:27:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:27:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:44 user nova-compute[76049]: INFO nova.compute.manager [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Terminating instance
Nov 15 11:27:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-a57ca404-ffa0-47b4-88cd-1359d9e9e251 req-d9bfef30-6374-498f-902f-93cccf160483 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-vif-unplugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a57ca404-ffa0-47b4-88cd-1359d9e9e251 req-d9bfef30-6374-498f-902f-93cccf160483 service nova] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a57ca404-ffa0-47b4-88cd-1359d9e9e251 req-d9bfef30-6374-498f-902f-93cccf160483 service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a57ca404-ffa0-47b4-88cd-1359d9e9e251 req-d9bfef30-6374-498f-902f-93cccf160483 service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-a57ca404-ffa0-47b4-88cd-1359d9e9e251 req-d9bfef30-6374-498f-902f-93cccf160483 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] No waiting events found dispatching network-vif-unplugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-a57ca404-ffa0-47b4-88cd-1359d9e9e251 req-d9bfef30-6374-498f-902f-93cccf160483 service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-vif-unplugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:27:45 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Instance destroyed successfully.
Nov 15 11:27:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'resources' on Instance uuid 6c9ce91d-18c5-478a-83ae-2f9b374c1416 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-569980044',display_name='tempest-AttachVolumeNegativeTest-server-569980044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-569980044',id=40,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhjWn/wcFK82/VlkysFKScmO19uQwQZQStQc+DrzfPlmhxQan4J04aqoqRhL3HgalU7fjSwDI1t3PVBUGNeXe0jROaOu7wZ5au6oo2ScMyGdUDqT8n8B323F42Ey9gxVw==',key_name='tempest-keypair-83178527',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-zwa059l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=6c9ce91d-18c5-478a-83ae-2f9b374c1416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "address": "fa:16:3e:67:6d:fa", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd95e33b-3c", "ovs_interfaceid": "cd95e33b-3cbe-45e4-888d-4d7c476fe725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:6d:fa,bridge_name='br-int',has_traffic_filtering=True,id=cd95e33b-3cbe-45e4-888d-4d7c476fe725,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd95e33b-3c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG os_vif [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:6d:fa,bridge_name='br-int',has_traffic_filtering=True,id=cd95e33b-3cbe-45e4-888d-4d7c476fe725,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd95e33b-3c') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd95e33b-3c, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10a48b33-a52a-4a6f-9e33-58f3e5f3201f) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:27:45 user nova-compute[76049]: INFO os_vif [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:6d:fa,bridge_name='br-int',has_traffic_filtering=True,id=cd95e33b-3cbe-45e4-888d-4d7c476fe725,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd95e33b-3c')
Nov 15 11:27:45 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Deleting instance files /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416_del
Nov 15 11:27:45 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Deletion of /opt/stack/data/nova/instances/6c9ce91d-18c5-478a-83ae-2f9b374c1416_del complete
Nov 15 11:27:45 user nova-compute[76049]: INFO nova.compute.manager [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 11:27:45 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:27:45 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:27:45 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Took 0.78 seconds to deallocate network for instance.
Nov 15 11:27:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:46 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Deleted allocations for instance 6c9ce91d-18c5-478a-83ae-2f9b374c1416
Nov 15 11:27:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1c3cc929-ccd9-45aa-b305-9966ee358451 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-25110f1f-d7b4-44d5-91e2-b76e88fbc653 req-3692ba52-b021-4d6d-9267-1c00803a79fb service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25110f1f-d7b4-44d5-91e2-b76e88fbc653 req-3692ba52-b021-4d6d-9267-1c00803a79fb service nova] Acquiring lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25110f1f-d7b4-44d5-91e2-b76e88fbc653 req-3692ba52-b021-4d6d-9267-1c00803a79fb service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-25110f1f-d7b4-44d5-91e2-b76e88fbc653 req-3692ba52-b021-4d6d-9267-1c00803a79fb service nova] Lock "6c9ce91d-18c5-478a-83ae-2f9b374c1416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-25110f1f-d7b4-44d5-91e2-b76e88fbc653 req-3692ba52-b021-4d6d-9267-1c00803a79fb service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] No waiting events found dispatching network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:27:46 user nova-compute[76049]: WARNING nova.compute.manager [req-25110f1f-d7b4-44d5-91e2-b76e88fbc653 req-3692ba52-b021-4d6d-9267-1c00803a79fb service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received unexpected event network-vif-plugged-cd95e33b-3cbe-45e4-888d-4d7c476fe725 for instance with vm_state deleted and task_state None.
Nov 15 11:27:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-25110f1f-d7b4-44d5-91e2-b76e88fbc653 req-3692ba52-b021-4d6d-9267-1c00803a79fb service nova] [instance: 6c9ce91d-18c5-478a-83ae-2f9b374c1416] Received event network-vif-deleted-cd95e33b-3cbe-45e4-888d-4d7c476fe725 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:27:47 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:27:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:27:53 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 is timed out.
Nov 15 11:27:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully detached device vdb from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the live domain config.
Nov 15 11:27:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svYTpVBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:27:53 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021c909-3331-4625-843b-e12451fbd707]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:27:53 user nova-compute[76049]: No targets found.
Nov 15 11:27:53 user nova-compute[76049]: iSNS:
Nov 15 11:27:53 user nova-compute[76049]: No targets found.
Nov 15 11:27:53 user nova-compute[76049]: STATIC:
Nov 15 11:27:53 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:27:53 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:53 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:53 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080
Nov 15 11:27:53 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:53 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:53 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:27:53 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:53 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:53 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f
Nov 15 11:27:53 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:53 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:53 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:27:53 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:53 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:53 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:27:53 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:27:53 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:27:53 user nova-compute[76049]: FIRMWARE:
Nov 15 11:27:53 user nova-compute[76049]: No targets found.
Nov 15 11:27:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:27:53 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:27:53 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ec7817-79ff-47d5-bd2e-3c5482c6171f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be4cb5-bc93-4ce7-bb12-df4f740692de]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)
Nov 15 11:27:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 (non-flash)
Nov 15 11:27:53 user nova-compute[76049]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)
Nov 15 11:27:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f626060a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db4a7ec-efd4-4aa0-9362-056dfd7cf211]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79abb91-2c3f-45b2-bdf4-d38cf5665ed6]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2ad016-c7aa-4357-ae74-51b5c777d984]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2ed345-e943-492d-b013-e048f4905146]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a903b3f4-dbba-48cd-91eb-70e345d551d3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc63d4c-720d-4426-9a37-d3e2672530a3]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260]
Nov 15 11:27:53 user nova-compute[76049]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080, portal: 172.16.0.220,3260] successful.
Nov 15 11:27:53 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:673c0dc0-930b-4a4e-96ab-7bab7e6c6080 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe717a5-69da-4762-a1f0-8cc6d87dd7a8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== disconnect_volume: return (334ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:27:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:27:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:27:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7548bf7e-545d-4328-bdab-83febbbdbac3 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:27:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:27:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:27:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:27:55 user nova-compute[76049]: INFO nova.compute.manager [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Detaching volume 1be40bc3-1744-491b-b55b-b997f8b7753f
Nov 15 11:27:55 user nova-compute[76049]: INFO nova.virt.block_device [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Attempting to driver detach volume 1be40bc3-1744-491b-b55b-b997f8b7753f from mountpoint /dev/vdc
Nov 15 11:27:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Attempting to detach device vdc from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:27:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:27:55 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:27:55 user nova-compute[76049]:   <source dev="/dev/sdg"/>
Nov 15 11:27:55 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:27:55 user nova-compute[76049]:   <serial>1be40bc3-1744-491b-b55b-b997f8b7753f</serial>
Nov 15 11:27:55 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 11:27:55 user nova-compute[76049]: </disk>
Nov 15 11:27:55 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:27:55 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully detached device vdc from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the persistent domain config.
Nov 15 11:27:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:27:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:27:55 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:27:55 user nova-compute[76049]:   <source dev="/dev/sdg"/>
Nov 15 11:27:55 user nova-compute[76049]:   <target dev="vdc" bus="virtio"/>
Nov 15 11:27:55 user nova-compute[76049]:   <serial>1be40bc3-1744-491b-b55b-b997f8b7753f</serial>
Nov 15 11:27:55 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 11:27:55 user nova-compute[76049]: </disk>
Nov 15 11:27:55 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:27:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:27:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:03 user nova-compute[76049]: INFO nova.compute.manager [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Rescuing
Nov 15 11:28:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG nova.network.neutron [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-32215666-4637-4041-828d-f5d40efe8aa4 req-b9d95f1f-9a57-4628-992f-d0a36e388ecc service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-unplugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-32215666-4637-4041-828d-f5d40efe8aa4 req-b9d95f1f-9a57-4628-992f-d0a36e388ecc service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-32215666-4637-4041-828d-f5d40efe8aa4 req-b9d95f1f-9a57-4628-992f-d0a36e388ecc service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-32215666-4637-4041-828d-f5d40efe8aa4 req-b9d95f1f-9a57-4628-992f-d0a36e388ecc service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-32215666-4637-4041-828d-f5d40efe8aa4 req-b9d95f1f-9a57-4628-992f-d0a36e388ecc service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-unplugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:04 user nova-compute[76049]: WARNING nova.compute.manager [req-32215666-4637-4041-828d-f5d40efe8aa4 req-b9d95f1f-9a57-4628-992f-d0a36e388ecc service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received unexpected event network-vif-unplugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with vm_state active and task_state rescuing.
Nov 15 11:28:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:04 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance destroyed successfully.
Nov 15 11:28:04 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Attempting rescue
Nov 15 11:28:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76049) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:28:04 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Creating image(s)
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue" returned: 0 in 0.059s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'migration_context' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.base [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<8b274e91-15bd-49c1-8fee-12908102ee15> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Start _get_guest_xml network_info=[{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:56:a1:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'resources' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.base [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<8b274e91-15bd-49c1-8fee-12908102ee15> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.base [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<8b274e91-15bd-49c1-8fee-12908102ee15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:28:05 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:05 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.base [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<8b274e91-15bd-49c1-8fee-12908102ee15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44323748',display_name='tempest-ServerRescueNegativeTestJSON-server-44323748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44323748',id=44,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-bfaao6du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:21Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=8b274e91-15bd-49c1-8fee-12908102ee15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:56:a1:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:56:a1:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.objects.base [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<8b274e91-15bd-49c1-8fee-12908102ee15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:28:05 user nova-compute[76049]:   <uuid>8b274e91-15bd-49c1-8fee-12908102ee15</uuid>
Nov 15 11:28:05 user nova-compute[76049]:   <name>instance-0000002c</name>
Nov 15 11:28:05 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:28:05 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:28:05 user nova-compute[76049]:   <metadata>
Nov 15 11:28:05 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:28:05 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:28:05 user nova-compute[76049]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-44323748</nova:name>
Nov 15 11:28:05 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:28:05</nova:creationTime>
Nov 15 11:28:05 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:28:05 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:28:05 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:28:05 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:28:05 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:28:05 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:28:05 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:28:05 user nova-compute[76049]:       <nova:owner>
Nov 15 11:28:05 user nova-compute[76049]:         <nova:user uuid="ab6a364f470c402bbd91712302c611cd">tempest-ServerRescueNegativeTestJSON-47045426-project-member</nova:user>
Nov 15 11:28:05 user nova-compute[76049]:         <nova:project uuid="fde1d2d3e99a4c96ab95220df3de4ad4">tempest-ServerRescueNegativeTestJSON-47045426</nova:project>
Nov 15 11:28:05 user nova-compute[76049]:       </nova:owner>
Nov 15 11:28:05 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:28:05 user nova-compute[76049]:       <nova:ports>
Nov 15 11:28:05 user nova-compute[76049]:         <nova:port uuid="6ca7af5f-fb76-4126-924c-2fb495e47964">
Nov 15 11:28:05 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 11:28:05 user nova-compute[76049]:         </nova:port>
Nov 15 11:28:05 user nova-compute[76049]:       </nova:ports>
Nov 15 11:28:05 user nova-compute[76049]:     </nova:instance>
Nov 15 11:28:05 user nova-compute[76049]:   </metadata>
Nov 15 11:28:05 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:28:05 user nova-compute[76049]:     <system>
Nov 15 11:28:05 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:28:05 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:28:05 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:28:05 user nova-compute[76049]:       <entry name="serial">8b274e91-15bd-49c1-8fee-12908102ee15</entry>
Nov 15 11:28:05 user nova-compute[76049]:       <entry name="uuid">8b274e91-15bd-49c1-8fee-12908102ee15</entry>
Nov 15 11:28:05 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:28:05 user nova-compute[76049]:     </system>
Nov 15 11:28:05 user nova-compute[76049]:   </sysinfo>
Nov 15 11:28:05 user nova-compute[76049]:   <os>
Nov 15 11:28:05 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:28:05 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:28:05 user nova-compute[76049]:   </os>
Nov 15 11:28:05 user nova-compute[76049]:   <features>
Nov 15 11:28:05 user nova-compute[76049]:     <acpi/>
Nov 15 11:28:05 user nova-compute[76049]:     <apic/>
Nov 15 11:28:05 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:28:05 user nova-compute[76049]:   </features>
Nov 15 11:28:05 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:28:05 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:28:05 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:28:05 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:28:05 user nova-compute[76049]:   </clock>
Nov 15 11:28:05 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:28:05 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:28:05 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:28:05 user nova-compute[76049]:   </cpu>
Nov 15 11:28:05 user nova-compute[76049]:   <devices>
Nov 15 11:28:05 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:28:05 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:28:05 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue"/>
Nov 15 11:28:05 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:28:05 user nova-compute[76049]:     </disk>
Nov 15 11:28:05 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:28:05 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:28:05 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk"/>
Nov 15 11:28:05 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:28:05 user nova-compute[76049]:     </disk>
Nov 15 11:28:05 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:28:05 user nova-compute[76049]:       <mac address="fa:16:3e:56:a1:c3"/>
Nov 15 11:28:05 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:28:05 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:28:05 user nova-compute[76049]:       <target dev="tap6ca7af5f-fb"/>
Nov 15 11:28:05 user nova-compute[76049]:     </interface>
Nov 15 11:28:05 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:28:05 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/console.log" append="off"/>
Nov 15 11:28:05 user nova-compute[76049]:     </serial>
Nov 15 11:28:05 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:28:05 user nova-compute[76049]:     <video>
Nov 15 11:28:05 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:28:05 user nova-compute[76049]:     </video>
Nov 15 11:28:05 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:28:05 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:28:05 user nova-compute[76049]:     </rng>
Nov 15 11:28:05 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:28:05 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:28:05 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:28:05 user nova-compute[76049]:     </memballoon>
Nov 15 11:28:05 user nova-compute[76049]:   </devices>
Nov 15 11:28:05 user nova-compute[76049]: </domain>
Nov 15 11:28:05 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:28:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance destroyed successfully.
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:28:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No VIF found with MAC fa:16:3e:56:a1:c3, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-14edf108-e422-4363-9137-8771751d3aca req-eb337883-ddd5-493d-98dd-7c11c27971ce service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14edf108-e422-4363-9137-8771751d3aca req-eb337883-ddd5-493d-98dd-7c11c27971ce service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14edf108-e422-4363-9137-8771751d3aca req-eb337883-ddd5-493d-98dd-7c11c27971ce service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14edf108-e422-4363-9137-8771751d3aca req-eb337883-ddd5-493d-98dd-7c11c27971ce service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-14edf108-e422-4363-9137-8771751d3aca req-eb337883-ddd5-493d-98dd-7c11c27971ce service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:06 user nova-compute[76049]: WARNING nova.compute.manager [req-14edf108-e422-4363-9137-8771751d3aca req-eb337883-ddd5-493d-98dd-7c11c27971ce service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received unexpected event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with vm_state active and task_state rescuing.
Nov 15 11:28:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:08 user nova-compute[76049]: WARNING nova.compute.manager [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received unexpected event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with vm_state active and task_state rescuing.
Nov 15 11:28:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:08 user nova-compute[76049]: WARNING nova.compute.manager [req-77abee43-b6c0-415d-b114-3f78049a9e10 req-2de93497-edaf-482f-9b21-94fbdee1e88f service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received unexpected event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with vm_state active and task_state rescuing.
Nov 15 11:28:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-71766831-44c4-458d-a17f-7196b4ddedcc tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:28:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 is timed out.
Nov 15 11:28:16 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully detached device vdc from instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181 from the live domain config.
Nov 15 11:28:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzInkwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:28:16 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[337b9af0-2453-45b1-b31a-70582b3f90ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:28:16 user nova-compute[76049]: No targets found.
Nov 15 11:28:16 user nova-compute[76049]: iSNS:
Nov 15 11:28:16 user nova-compute[76049]: No targets found.
Nov 15 11:28:16 user nova-compute[76049]: STATIC:
Nov 15 11:28:16 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:28:16 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:28:16 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:28:16 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:28:16 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:28:16 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:28:16 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f
Nov 15 11:28:16 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:28:16 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:28:16 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:28:16 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:28:16 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:28:16 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:28:16 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:28:16 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:28:16 user nova-compute[76049]: FIRMWARE:
Nov 15 11:28:16 user nova-compute[76049]: No targets found.
Nov 15 11:28:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:28:16 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:28:16 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[421091f2-b37b-4266-a987-8ec73b94a4dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d5643-6b21-4c6a-9dbd-2bf4edab4953]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)
Nov 15 11:28:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:28:16 user nova-compute[76049]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f (non-flash)
Nov 15 11:28:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62847d7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f'): ({'sdg'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Removing single pathed devices sdg {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc92119-b6a3-495e-82d9-c2357df62583]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc48668-0ad6-41e1-b968-45823fc49f1a]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Flushing IO for device /dev/sdg {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0deaf0-6746-422d-9557-a6359b4293e3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[67412a97-6ef0-4f67-9766-242cae73f651]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] SCSI volumes sdg have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88f3804-2c00-4338-b351-b67060f2e3ce]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac31f027-1c61-456b-bb2b-444efdce4467]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260]
Nov 15 11:28:16 user nova-compute[76049]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f, portal: 172.16.0.220,3260] successful.
Nov 15 11:28:16 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be40bc3-1744-491b-b55b-b997f8b7753f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c65590-5645-48ad-9d49-2d06ef677489]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] <== disconnect_volume: return (331ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:28:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:28:17 user nova-compute[76049]: DEBUG nova.objects.instance [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'flavor' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-15986cd7-b9d7-491a-be0d-1ce626b7dc91 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.679s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:18 user nova-compute[76049]: INFO nova.compute.manager [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Terminating instance
Nov 15 11:28:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-c5891208-8709-487a-8ce4-b99737fb3ced req-b5aa99cd-c726-4632-a11a-c6be515ad2f4 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-vif-unplugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c5891208-8709-487a-8ce4-b99737fb3ced req-b5aa99cd-c726-4632-a11a-c6be515ad2f4 service nova] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c5891208-8709-487a-8ce4-b99737fb3ced req-b5aa99cd-c726-4632-a11a-c6be515ad2f4 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c5891208-8709-487a-8ce4-b99737fb3ced req-b5aa99cd-c726-4632-a11a-c6be515ad2f4 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-c5891208-8709-487a-8ce4-b99737fb3ced req-b5aa99cd-c726-4632-a11a-c6be515ad2f4 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] No waiting events found dispatching network-vif-unplugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-c5891208-8709-487a-8ce4-b99737fb3ced req-b5aa99cd-c726-4632-a11a-c6be515ad2f4 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-vif-unplugged-677b633e-c8cd-403f-81f2-a8d11f695029 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:28:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Instance destroyed successfully.
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lazy-loading 'resources' on Instance uuid d8ce85ec-1a8b-4231-80b7-dd7ce090f181 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-870433862',display_name='tempest-AttachVolumeTestJSON-server-870433862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-870433862',id=42,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz9vAAQ0beQlA44G7dwXiUm8yUVqcBhTQvvRULI+bM25yIHpw/ZcalUTWA7s/1T9VsMYhqXjzX2ZPcX1egZttD3Tilr5/P3995t7TddkIKKf6p5Hy25TKv1oJzqlJJTkQ==',key_name='tempest-keypair-49661704',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b66e129b2747494fb8fa7cb798b7dc3c',ramdisk_id='',reservation_id='r-qp1c0stn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-401613630',owner_user_name='tempest-AttachVolumeTestJSON-401613630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:25:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab3b8846d7649a78b8f0be07f51945e',uuid=d8ce85ec-1a8b-4231-80b7-dd7ce090f181,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converting VIF {"id": "677b633e-c8cd-403f-81f2-a8d11f695029", "address": "fa:16:3e:e2:33:3b", "network": {"id": "13a32209-ec1e-4b14-a927-1d8f2869574b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-450652003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66e129b2747494fb8fa7cb798b7dc3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap677b633e-c8", "ovs_interfaceid": "677b633e-c8cd-403f-81f2-a8d11f695029", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:33:3b,bridge_name='br-int',has_traffic_filtering=True,id=677b633e-c8cd-403f-81f2-a8d11f695029,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap677b633e-c8') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG os_vif [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:33:3b,bridge_name='br-int',has_traffic_filtering=True,id=677b633e-c8cd-403f-81f2-a8d11f695029,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap677b633e-c8') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap677b633e-c8, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2afc723-11c0-44ed-9d25-258e78f9c169) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:28:19 user nova-compute[76049]: INFO os_vif [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:33:3b,bridge_name='br-int',has_traffic_filtering=True,id=677b633e-c8cd-403f-81f2-a8d11f695029,network=Network(13a32209-ec1e-4b14-a927-1d8f2869574b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap677b633e-c8')
Nov 15 11:28:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Deleting instance files /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181_del
Nov 15 11:28:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Deletion of /opt/stack/data/nova/instances/d8ce85ec-1a8b-4231-80b7-dd7ce090f181_del complete
Nov 15 11:28:19 user nova-compute[76049]: INFO nova.compute.manager [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 11:28:19 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:28:19 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:28:20 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:20 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Took 1.34 seconds to deallocate network for instance.
Nov 15 11:28:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-9b250ad2-094f-4470-ac7e-ef81b9df8d9a req-9e67b5a5-fe63-4d41-822d-6afca5337546 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9b250ad2-094f-4470-ac7e-ef81b9df8d9a req-9e67b5a5-fe63-4d41-822d-6afca5337546 service nova] Acquiring lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9b250ad2-094f-4470-ac7e-ef81b9df8d9a req-9e67b5a5-fe63-4d41-822d-6afca5337546 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9b250ad2-094f-4470-ac7e-ef81b9df8d9a req-9e67b5a5-fe63-4d41-822d-6afca5337546 service nova] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-9b250ad2-094f-4470-ac7e-ef81b9df8d9a req-9e67b5a5-fe63-4d41-822d-6afca5337546 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] No waiting events found dispatching network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:21 user nova-compute[76049]: WARNING nova.compute.manager [req-9b250ad2-094f-4470-ac7e-ef81b9df8d9a req-9e67b5a5-fe63-4d41-822d-6afca5337546 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received unexpected event network-vif-plugged-677b633e-c8cd-403f-81f2-a8d11f695029 for instance with vm_state deleted and task_state None.
Nov 15 11:28:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-9b250ad2-094f-4470-ac7e-ef81b9df8d9a req-9e67b5a5-fe63-4d41-822d-6afca5337546 service nova] [instance: d8ce85ec-1a8b-4231-80b7-dd7ce090f181] Received event network-vif-deleted-677b633e-c8cd-403f-81f2-a8d11f695029 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:28:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:21 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Deleted allocations for instance d8ce85ec-1a8b-4231-80b7-dd7ce090f181
Nov 15 11:28:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-95111a93-d9ae-4a91-b937-2e2534399264 tempest-AttachVolumeTestJSON-401613630 tempest-AttachVolumeTestJSON-401613630-project-member] Lock "d8ce85ec-1a8b-4231-80b7-dd7ce090f181" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-changed-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Refreshing instance network info cache due to event network-changed-ebc8de16-4b06-4f6c-af63-452043a5401a. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:28:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] Acquiring lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] Acquired lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Refreshing network info cache for port ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:28:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updated VIF entry in instance network info cache for port ebc8de16-4b06-4f6c-af63-452043a5401a. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:28:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updating instance_info_cache with network_info: [{"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b8f14323-9373-455f-9a0f-4f411cd10750 req-b5ca5dd4-0aa1-4d91-888e-b1ea395cac05 service nova] Releasing lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:28:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid d0f0287a-5e2c-4a02-8490-da45ae1e86b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:29 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updating instance_info_cache with network_info: [{"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-d0f0287a-5e2c-4a02-8490-da45ae1e86b9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:29 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:28:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "0a6400ee-9add-4632-ab9c-742951628122" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "0a6400ee-9add-4632-ab9c-742951628122" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:30 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:28:30 user nova-compute[76049]: INFO nova.compute.claims [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Claim successful on node user
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:28:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.policy [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac7d77f50629413bb7b6c9457156af67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0917737287484e2498e2dcf616b8679e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:28:31 user nova-compute[76049]: INFO nova.virt.block_device [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Booting with volume 3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 at /dev/vda
Nov 15 11:28:31 user nova-compute[76049]: DEBUG os_brick.utils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be028e5-b9b0-45ab-875b-a2e2eec9a289]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8f760a-426c-4768-9fa4-98642000eb4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ee6d2-2ada-458e-961a-eb5a7ec7c80f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449376e-501a-48de-919e-d73d7ed2f96f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:28:31 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:28:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[343163a7-4e64-4cc4-944c-e86350cf58ab]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG os_brick.utils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updating existing volume attachment record: 86149a6a-9230-4cab-aebd-1d7e8e1e051a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:28:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Successfully created port: c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Successfully updated port: c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquired lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-changed-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Refreshing instance network info cache due to event network-changed-c20c2c5b-96b5-40fc-ad78-279421ee9df6. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] Acquiring lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updating instance_info_cache with network_info: [{"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Releasing lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Instance network_info: |[{"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] Acquired lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Refreshing network info cache for port c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updated VIF entry in instance network info cache for port c20c2c5b-96b5-40fc-ad78-279421ee9df6. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updating instance_info_cache with network_info: [{"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-4b24626e-3b39-43c2-8991-c672a3d6c80c req-cfc97831-5224-4ea5-8ae3-6a5a66fcd64c service nova] Releasing lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:28:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:28:36 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Creating image(s)
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Did not create local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Ensure instance console log exists: /opt/stack/data/nova/instances/0a6400ee-9add-4632-ab9c-742951628122/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Start _get_guest_xml network_info=[{"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxfYaIZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a6400ee-9add-4632-ab9c-742951628122', 'attached_at': '', 'detached_at': '', 'volume_id': '3c0b53e4-353a-4fbc-a019-7c00b32fc4b9', 'serial': '3c0b53e4-353a-4fbc-a019-7c00b32fc4b9'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '86149a6a-9230-4cab-aebd-1d7e8e1e051a', 'volume_type': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:28:36 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:36 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxfYaIZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:28:36 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:28:36 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:28:36 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b04e7-ca05-42ca-aa02-65fd1d338ac9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:28:36 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c0809-c90e-409f-9008-a751760849f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9] added
Nov 15 11:28:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a869e32d-5862-4d65-a0a2-e886dff22667]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155dd2d-a8d9-4efe-a293-f4b0fb847d4a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxfYaIZJ {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxfYaIZJ" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4800e088-28c9-4003-acf5-49300ac21d48]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RxfYaIZJ'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02d5688-83f7-4b2c-a1d6-1103d8f814a3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[739328a1-cc05-4afa-b33f-875c8c3ff85f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2284d3a6-59e6-4725-a681-acccbd8dc43a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260]
Nov 15 11:28:36 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260] successful.
Nov 15 11:28:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc4b03d-fd03-4b02-b41f-777a200c21f7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d07754-460a-4e8b-b36f-a9e2a06b0dff]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:28:36 user nova-compute[76049]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)
Nov 15 11:28:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[341fd8a0-12f2-46ec-b908-d82b7de815a4]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:28:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxfYaIZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23062643333616162', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062643333616162', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1508111719',display_name='tempest-TestVolumeBootPattern-server-1508111719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1508111719',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-m0fc7uic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:28:31Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=0a6400ee-9add-4632-ab9c-742951628122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9f:93,bridge_name='br-int',has_traffic_filtering=True,id=c20c2c5b-96b5-40fc-ad78-279421ee9df6,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20c2c5b-96') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a6400ee-9add-4632-ab9c-742951628122 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:28:37 user nova-compute[76049]:   <uuid>0a6400ee-9add-4632-ab9c-742951628122</uuid>
Nov 15 11:28:37 user nova-compute[76049]:   <name>instance-0000002e</name>
Nov 15 11:28:37 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:28:37 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:28:37 user nova-compute[76049]:   <metadata>
Nov 15 11:28:37 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:28:37 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:28:37 user nova-compute[76049]:       <nova:name>tempest-TestVolumeBootPattern-server-1508111719</nova:name>
Nov 15 11:28:37 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:28:36</nova:creationTime>
Nov 15 11:28:37 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:28:37 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:28:37 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:28:37 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:28:37 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:28:37 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:28:37 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:28:37 user nova-compute[76049]:       <nova:owner>
Nov 15 11:28:37 user nova-compute[76049]:         <nova:user uuid="ac7d77f50629413bb7b6c9457156af67">tempest-TestVolumeBootPattern-2118546811-project-member</nova:user>
Nov 15 11:28:37 user nova-compute[76049]:         <nova:project uuid="0917737287484e2498e2dcf616b8679e">tempest-TestVolumeBootPattern-2118546811</nova:project>
Nov 15 11:28:37 user nova-compute[76049]:       </nova:owner>
Nov 15 11:28:37 user nova-compute[76049]:       <nova:ports>
Nov 15 11:28:37 user nova-compute[76049]:         <nova:port uuid="c20c2c5b-96b5-40fc-ad78-279421ee9df6">
Nov 15 11:28:37 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 11:28:37 user nova-compute[76049]:         </nova:port>
Nov 15 11:28:37 user nova-compute[76049]:       </nova:ports>
Nov 15 11:28:37 user nova-compute[76049]:     </nova:instance>
Nov 15 11:28:37 user nova-compute[76049]:   </metadata>
Nov 15 11:28:37 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:28:37 user nova-compute[76049]:     <system>
Nov 15 11:28:37 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:28:37 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:28:37 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:28:37 user nova-compute[76049]:       <entry name="serial">0a6400ee-9add-4632-ab9c-742951628122</entry>
Nov 15 11:28:37 user nova-compute[76049]:       <entry name="uuid">0a6400ee-9add-4632-ab9c-742951628122</entry>
Nov 15 11:28:37 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:28:37 user nova-compute[76049]:     </system>
Nov 15 11:28:37 user nova-compute[76049]:   </sysinfo>
Nov 15 11:28:37 user nova-compute[76049]:   <os>
Nov 15 11:28:37 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:28:37 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:28:37 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:28:37 user nova-compute[76049]:   </os>
Nov 15 11:28:37 user nova-compute[76049]:   <features>
Nov 15 11:28:37 user nova-compute[76049]:     <acpi/>
Nov 15 11:28:37 user nova-compute[76049]:     <apic/>
Nov 15 11:28:37 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:28:37 user nova-compute[76049]:   </features>
Nov 15 11:28:37 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:28:37 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:28:37 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:28:37 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:28:37 user nova-compute[76049]:   </clock>
Nov 15 11:28:37 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:28:37 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:28:37 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:28:37 user nova-compute[76049]:   </cpu>
Nov 15 11:28:37 user nova-compute[76049]:   <devices>
Nov 15 11:28:37 user nova-compute[76049]:     <disk type="block" device="disk">
Nov 15 11:28:37 user nova-compute[76049]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:28:37 user nova-compute[76049]:       <source dev="/dev/sde"/>
Nov 15 11:28:37 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:28:37 user nova-compute[76049]:       <serial>3c0b53e4-353a-4fbc-a019-7c00b32fc4b9</serial>
Nov 15 11:28:37 user nova-compute[76049]:     </disk>
Nov 15 11:28:37 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:28:37 user nova-compute[76049]:       <mac address="fa:16:3e:4f:9f:93"/>
Nov 15 11:28:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:28:37 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:28:37 user nova-compute[76049]:       <target dev="tapc20c2c5b-96"/>
Nov 15 11:28:37 user nova-compute[76049]:     </interface>
Nov 15 11:28:37 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:28:37 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/0a6400ee-9add-4632-ab9c-742951628122/console.log" append="off"/>
Nov 15 11:28:37 user nova-compute[76049]:     </serial>
Nov 15 11:28:37 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:28:37 user nova-compute[76049]:     <video>
Nov 15 11:28:37 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:28:37 user nova-compute[76049]:     </video>
Nov 15 11:28:37 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:28:37 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:28:37 user nova-compute[76049]:     </rng>
Nov 15 11:28:37 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:28:37 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:28:37 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:28:37 user nova-compute[76049]:     </memballoon>
Nov 15 11:28:37 user nova-compute[76049]:   </devices>
Nov 15 11:28:37 user nova-compute[76049]: </domain>
Nov 15 11:28:37 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1508111719',display_name='tempest-TestVolumeBootPattern-server-1508111719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1508111719',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-m0fc7uic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:28:31Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=0a6400ee-9add-4632-ab9c-742951628122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9f:93,bridge_name='br-int',has_traffic_filtering=True,id=c20c2c5b-96b5-40fc-ad78-279421ee9df6,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20c2c5b-96') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG os_vif [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9f:93,bridge_name='br-int',has_traffic_filtering=True,id=c20c2c5b-96b5-40fc-ad78-279421ee9df6,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20c2c5b-96') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3de8f2fe-cc01-59bc-92f8-c1fbcd2f5fd9', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc20c2c5b-96, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc20c2c5b-96, col_values=(('qos', UUID('2379c78e-2514-4b49-92bf-f123938e2520')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc20c2c5b-96, col_values=(('external_ids', {'iface-id': 'c20c2c5b-96b5-40fc-ad78-279421ee9df6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:9f:93', 'vm-uuid': '0a6400ee-9add-4632-ab9c-742951628122'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:37 user nova-compute[76049]: INFO os_vif [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9f:93,bridge_name='br-int',has_traffic_filtering=True,id=c20c2c5b-96b5-40fc-ad78-279421ee9df6,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20c2c5b-96')
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:28:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] No VIF found with MAC fa:16:3e:4f:9f:93, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:28:38 user nova-compute[76049]: INFO nova.compute.claims [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Claim successful on node user
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:28:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:28:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.policy [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3405f82948e641e685ecccb007c4c60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d20305cc32b4da29ebe034a326e401e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:28:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Creating image(s)
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "/opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "/opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-c58c3fc5-21f9-4271-876f-eff8006f1903 req-93119a71-2494-4cf1-86ee-979f745908e2 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c58c3fc5-21f9-4271-876f-eff8006f1903 req-93119a71-2494-4cf1-86ee-979f745908e2 service nova] Acquiring lock "0a6400ee-9add-4632-ab9c-742951628122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c58c3fc5-21f9-4271-876f-eff8006f1903 req-93119a71-2494-4cf1-86ee-979f745908e2 service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c58c3fc5-21f9-4271-876f-eff8006f1903 req-93119a71-2494-4cf1-86ee-979f745908e2 service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.compute.manager [req-c58c3fc5-21f9-4271-876f-eff8006f1903 req-93119a71-2494-4cf1-86ee-979f745908e2 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] No waiting events found dispatching network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:39 user nova-compute[76049]: WARNING nova.compute.manager [req-c58c3fc5-21f9-4271-876f-eff8006f1903 req-93119a71-2494-4cf1-86ee-979f745908e2 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received unexpected event network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 for instance with vm_state building and task_state spawning.
Nov 15 11:28:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk 1073741824" returned: 0 in 0.053s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.network.neutron [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Successfully created port: 1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Cannot resize image /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Ensure instance console log exists: /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Successfully updated port: 1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquired lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-changed-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Refreshing instance network info cache due to event network-changed-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] Acquiring lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Updating instance_info_cache with network_info: [{"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Releasing lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Instance network_info: |[{"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] Acquired lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Refreshing network info cache for port 1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Start _get_guest_xml network_info=[{"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:28:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-644996162',display_name='tempest-AttachVolumeNegativeTest-server-644996162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-644996162',id=47,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsO9u7SHhwq2Det3zPhVYULaVuSn8JcfA6ujGkhi2ZxlUhW7nHKDmDpvO8XCVHzWziaM018YbcvbLVNadUUw79rUw8BIP+QJcCMsAYIpkoTRhKeNeRRN0j3T/3nwAQaKQ==',key_name='tempest-keypair-1289936094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-lnggc696',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=fec692f0-8e23-450d-9537-759949ccf95f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:3c:5b,bridge_name='br-int',has_traffic_filtering=True,id=1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fcc8f-11') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.objects.instance [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'pci_devices' on Instance uuid fec692f0-8e23-450d-9537-759949ccf95f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:28:40 user nova-compute[76049]:   <uuid>fec692f0-8e23-450d-9537-759949ccf95f</uuid>
Nov 15 11:28:40 user nova-compute[76049]:   <name>instance-0000002f</name>
Nov 15 11:28:40 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:28:40 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:28:40 user nova-compute[76049]:   <metadata>
Nov 15 11:28:40 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:28:40 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:28:40 user nova-compute[76049]:       <nova:name>tempest-AttachVolumeNegativeTest-server-644996162</nova:name>
Nov 15 11:28:40 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:28:40</nova:creationTime>
Nov 15 11:28:40 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:28:40 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:28:40 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:28:40 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:28:40 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:28:40 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:28:40 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:28:40 user nova-compute[76049]:       <nova:owner>
Nov 15 11:28:40 user nova-compute[76049]:         <nova:user uuid="3405f82948e641e685ecccb007c4c60d">tempest-AttachVolumeNegativeTest-2136408759-project-member</nova:user>
Nov 15 11:28:40 user nova-compute[76049]:         <nova:project uuid="2d20305cc32b4da29ebe034a326e401e">tempest-AttachVolumeNegativeTest-2136408759</nova:project>
Nov 15 11:28:40 user nova-compute[76049]:       </nova:owner>
Nov 15 11:28:40 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:28:40 user nova-compute[76049]:       <nova:ports>
Nov 15 11:28:40 user nova-compute[76049]:         <nova:port uuid="1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f">
Nov 15 11:28:40 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 11:28:40 user nova-compute[76049]:         </nova:port>
Nov 15 11:28:40 user nova-compute[76049]:       </nova:ports>
Nov 15 11:28:40 user nova-compute[76049]:     </nova:instance>
Nov 15 11:28:40 user nova-compute[76049]:   </metadata>
Nov 15 11:28:40 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:28:40 user nova-compute[76049]:     <system>
Nov 15 11:28:40 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:28:40 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:28:40 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:28:40 user nova-compute[76049]:       <entry name="serial">fec692f0-8e23-450d-9537-759949ccf95f</entry>
Nov 15 11:28:40 user nova-compute[76049]:       <entry name="uuid">fec692f0-8e23-450d-9537-759949ccf95f</entry>
Nov 15 11:28:40 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:28:40 user nova-compute[76049]:     </system>
Nov 15 11:28:40 user nova-compute[76049]:   </sysinfo>
Nov 15 11:28:40 user nova-compute[76049]:   <os>
Nov 15 11:28:40 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:28:40 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:28:40 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:28:40 user nova-compute[76049]:   </os>
Nov 15 11:28:40 user nova-compute[76049]:   <features>
Nov 15 11:28:40 user nova-compute[76049]:     <acpi/>
Nov 15 11:28:40 user nova-compute[76049]:     <apic/>
Nov 15 11:28:40 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:28:40 user nova-compute[76049]:   </features>
Nov 15 11:28:40 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:28:40 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:28:40 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:28:40 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:28:40 user nova-compute[76049]:   </clock>
Nov 15 11:28:40 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:28:40 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:28:40 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:28:40 user nova-compute[76049]:   </cpu>
Nov 15 11:28:40 user nova-compute[76049]:   <devices>
Nov 15 11:28:40 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:28:40 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:28:40 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk"/>
Nov 15 11:28:40 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:28:40 user nova-compute[76049]:     </disk>
Nov 15 11:28:40 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:28:40 user nova-compute[76049]:       <mac address="fa:16:3e:65:3c:5b"/>
Nov 15 11:28:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:28:40 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:28:40 user nova-compute[76049]:       <target dev="tap1f6fcc8f-11"/>
Nov 15 11:28:40 user nova-compute[76049]:     </interface>
Nov 15 11:28:40 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:28:40 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/console.log" append="off"/>
Nov 15 11:28:40 user nova-compute[76049]:     </serial>
Nov 15 11:28:40 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:28:40 user nova-compute[76049]:     <video>
Nov 15 11:28:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:28:40 user nova-compute[76049]:     </video>
Nov 15 11:28:40 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:28:40 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:28:40 user nova-compute[76049]:     </rng>
Nov 15 11:28:40 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:28:40 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:28:40 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:28:40 user nova-compute[76049]:     </memballoon>
Nov 15 11:28:40 user nova-compute[76049]:   </devices>
Nov 15 11:28:40 user nova-compute[76049]: </domain>
Nov 15 11:28:40 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-644996162',display_name='tempest-AttachVolumeNegativeTest-server-644996162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-644996162',id=47,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsO9u7SHhwq2Det3zPhVYULaVuSn8JcfA6ujGkhi2ZxlUhW7nHKDmDpvO8XCVHzWziaM018YbcvbLVNadUUw79rUw8BIP+QJcCMsAYIpkoTRhKeNeRRN0j3T/3nwAQaKQ==',key_name='tempest-keypair-1289936094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-lnggc696',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=fec692f0-8e23-450d-9537-759949ccf95f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:3c:5b,bridge_name='br-int',has_traffic_filtering=True,id=1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fcc8f-11') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG os_vif [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:3c:5b,bridge_name='br-int',has_traffic_filtering=True,id=1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fcc8f-11') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f9eaeaa-f7ba-5721-a457-0377edba29b4', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f6fcc8f-11, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f6fcc8f-11, col_values=(('qos', UUID('40a3c5ae-6d32-4b6b-afec-54b6e3f7abbe')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f6fcc8f-11, col_values=(('external_ids', {'iface-id': '1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:3c:5b', 'vm-uuid': 'fec692f0-8e23-450d-9537-759949ccf95f'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:40 user nova-compute[76049]: INFO os_vif [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:3c:5b,bridge_name='br-int',has_traffic_filtering=True,id=1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fcc8f-11')
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No VIF found with MAC fa:16:3e:65:3c:5b, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Updated VIF entry in instance network info cache for port 1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Updating instance_info_cache with network_info: [{"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-58ddee08-1fdd-4d88-b4b0-93260f30146f req-6b8462a9-6c01-4b6e-bb5f-a329d55e2122 service nova] Releasing lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:28:41 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Instance spawned successfully.
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-a91c44ff-aaf2-4431-aa9d-5d86e1bbe7b0 req-711a5e6c-d511-4087-bb26-6b4f846c98b0 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a91c44ff-aaf2-4431-aa9d-5d86e1bbe7b0 req-711a5e6c-d511-4087-bb26-6b4f846c98b0 service nova] Acquiring lock "0a6400ee-9add-4632-ab9c-742951628122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a91c44ff-aaf2-4431-aa9d-5d86e1bbe7b0 req-711a5e6c-d511-4087-bb26-6b4f846c98b0 service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a91c44ff-aaf2-4431-aa9d-5d86e1bbe7b0 req-711a5e6c-d511-4087-bb26-6b4f846c98b0 service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-a91c44ff-aaf2-4431-aa9d-5d86e1bbe7b0 req-711a5e6c-d511-4087-bb26-6b4f846c98b0 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] No waiting events found dispatching network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:41 user nova-compute[76049]: WARNING nova.compute.manager [req-a91c44ff-aaf2-4431-aa9d-5d86e1bbe7b0 req-711a5e6c-d511-4087-bb26-6b4f846c98b0 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received unexpected event network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 for instance with vm_state building and task_state spawning.
Nov 15 11:28:41 user nova-compute[76049]: INFO nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 15 11:28:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:41 user nova-compute[76049]: INFO nova.compute.manager [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Took 10.84 seconds to build instance.
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-f8c81659-a609-40c9-a4db-d4a0c212dead tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "0a6400ee-9add-4632-ab9c-742951628122" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.948s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:28:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:28:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-c6eb5da9-0848-4143-b777-0698cc7b69df req-e3429d68-77b9-437a-ae5b-e203fca55f11 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c6eb5da9-0848-4143-b777-0698cc7b69df req-e3429d68-77b9-437a-ae5b-e203fca55f11 service nova] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c6eb5da9-0848-4143-b777-0698cc7b69df req-e3429d68-77b9-437a-ae5b-e203fca55f11 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c6eb5da9-0848-4143-b777-0698cc7b69df req-e3429d68-77b9-437a-ae5b-e203fca55f11 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-c6eb5da9-0848-4143-b777-0698cc7b69df req-e3429d68-77b9-437a-ae5b-e203fca55f11 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] No waiting events found dispatching network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:44 user nova-compute[76049]: WARNING nova.compute.manager [req-c6eb5da9-0848-4143-b777-0698cc7b69df req-e3429d68-77b9-437a-ae5b-e203fca55f11 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received unexpected event network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f for instance with vm_state building and task_state spawning.
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-bd63cb64-a3c6-43e2-b645-39dea95ec3f6 req-9d3f5567-319e-4f82-9f3f-5f4a7851b3b3 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd63cb64-a3c6-43e2-b645-39dea95ec3f6 req-9d3f5567-319e-4f82-9f3f-5f4a7851b3b3 service nova] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd63cb64-a3c6-43e2-b645-39dea95ec3f6 req-9d3f5567-319e-4f82-9f3f-5f4a7851b3b3 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bd63cb64-a3c6-43e2-b645-39dea95ec3f6 req-9d3f5567-319e-4f82-9f3f-5f4a7851b3b3 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-bd63cb64-a3c6-43e2-b645-39dea95ec3f6 req-9d3f5567-319e-4f82-9f3f-5f4a7851b3b3 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] No waiting events found dispatching network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:28:44 user nova-compute[76049]: WARNING nova.compute.manager [req-bd63cb64-a3c6-43e2-b645-39dea95ec3f6 req-9d3f5567-319e-4f82-9f3f-5f4a7851b3b3 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received unexpected event network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f for instance with vm_state building and task_state spawning.
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Going to confirm migration 2 {{(pid=76049) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 11:28:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7783MB free_disk=24.969650268554688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Instance spawned successfully.
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:28:44 user nova-compute[76049]: INFO nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Applying migration context for instance 6426e887-3097-4c19-9340-cd1a76131216 as it has an incoming, in-progress migration 19ccb52c-de96-449d-994e-d15112a67546. Migration status is confirming {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 11:28:44 user nova-compute[76049]: INFO nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating resource usage from migration 19ccb52c-de96-449d-994e-d15112a67546
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 65cf42f2-4fc4-4e88-a78e-5a3babde37ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Migration 19ccb52c-de96-449d-994e-d15112a67546 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6426e887-3097-4c19-9340-cd1a76131216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 0a6400ee-9add-4632-ab9c-742951628122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fec692f0-8e23-450d-9537-759949ccf95f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:28:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquired lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'info_cache' on Instance uuid 6426e887-3097-4c19-9340-cd1a76131216 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:45 user nova-compute[76049]: INFO nova.compute.manager [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Took 6.72 seconds to build instance.
Nov 15 11:28:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-808b8051-ce96-4f90-95d8-0011826c3c84 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.830s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating instance_info_cache with network_info: [{"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Releasing lock "refresh_cache-6426e887-3097-4c19-9340-cd1a76131216" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'migration_context' on Instance uuid 6426e887-3097-4c19-9340-cd1a76131216 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.objects.base [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Object Instance<6426e887-3097-4c19-9340-cd1a76131216> lazy-loaded attributes: info_cache,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:28:45 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:28:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.442s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:46 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Deleted allocation for migration 19ccb52c-de96-449d-994e-d15112a67546
Nov 15 11:28:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ccbdb172-eeb0-4122-9fbd-1b0df07e6ccd tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.461s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:28:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:28:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:28:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:28:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:28:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:28:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:29:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:29:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:29:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:29:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:29:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:29:27 user nova-compute[76049]: INFO nova.compute.manager [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Terminating instance
Nov 15 11:29:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a5a6d4b-e271-454f-8731-7ab8bae8b31a req-b7705e0a-2c3f-4dfe-ac2c-e0d7536e124c service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a5a6d4b-e271-454f-8731-7ab8bae8b31a req-b7705e0a-2c3f-4dfe-ac2c-e0d7536e124c service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a5a6d4b-e271-454f-8731-7ab8bae8b31a req-b7705e0a-2c3f-4dfe-ac2c-e0d7536e124c service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a5a6d4b-e271-454f-8731-7ab8bae8b31a req-b7705e0a-2c3f-4dfe-ac2c-e0d7536e124c service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a5a6d4b-e271-454f-8731-7ab8bae8b31a req-b7705e0a-2c3f-4dfe-ac2c-e0d7536e124c service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a5a6d4b-e271-454f-8731-7ab8bae8b31a req-b7705e0a-2c3f-4dfe-ac2c-e0d7536e124c service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-unplugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Instance destroyed successfully.
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'resources' on Instance uuid 7220132d-4ce3-4dfb-b119-4bc6c163fcd8 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911990954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-911990954',id=39,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-7vl5d4pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:27:41Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=7220132d-4ce3-4dfb-b119-4bc6c163fcd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "address": "fa:16:3e:86:56:10", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1e98aa-53", "ovs_interfaceid": "8a1e98aa-536d-4e05-9833-e8c663128e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_vif [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a1e98aa-53, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afe832ef-e647-48c3-ab85-88a5597c01d7) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:29:28 user nova-compute[76049]: INFO os_vif [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:56:10,bridge_name='br-int',has_traffic_filtering=True,id=8a1e98aa-536d-4e05-9833-e8c663128e8c,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1e98aa-53')
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjkQmdhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:29:28 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[870de62d-ba73-4ae5-9aeb-3c37fdb21cdf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:29:28 user nova-compute[76049]: No targets found.
Nov 15 11:29:28 user nova-compute[76049]: iSNS:
Nov 15 11:29:28 user nova-compute[76049]: No targets found.
Nov 15 11:29:28 user nova-compute[76049]: STATIC:
Nov 15 11:29:28 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:29:28 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:29:28 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:29:28 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:29:28 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:29:28 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:29:28 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9
Nov 15 11:29:28 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:29:28 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:29:28 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67
Nov 15 11:29:28 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:29:28 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:29:28 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:29:28 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:29:28 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:29:28 user nova-compute[76049]: FIRMWARE:
Nov 15 11:29:28 user nova-compute[76049]: No targets found.
Nov 15 11:29:28 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:29:28 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:29:28 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f79814-30ce-4bc4-af66-48af96ade1e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a709b-3ab0-4b93-abfc-9c47b1062bcf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)
Nov 15 11:29:28 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:29:28 user nova-compute[76049]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)
Nov 15 11:29:28 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629416e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67'): ({'sdf'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Removing single pathed devices sdf {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac29d3c-48c8-4921-8674-8f2897097979]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0857d247-3966-433b-bbb1-04fdaad9c8ec]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flushing IO for device /dev/sdf {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[427d1f5c-ef51-4270-84d9-356466e8a46f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.063s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa1e996-decf-4128-bd11-065ae09a1393]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] SCSI volumes sdf have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_69d2f17b', '/dev/disk/by-id/scsi-1SCST_BIO69d2f17b-57e174699581ceb9', '/dev/disk/by-id/scsi-23537653137343639') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21cc8b5-064c-4b51-86ad-86ef654b0c50]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180fcb2-8dce-4eb6-b6ea-e665c4e81cc0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[848488fb-3c28-4263-97b5-7bc4ca522b81]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260]
Nov 15 11:29:28 user nova-compute[76049]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67, portal: 172.16.0.220,3260] successful.
Nov 15 11:29:28 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d426c2c-08bd-4f23-8733-52e4255dda67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7166c9ee-8144-4ab3-85ac-e14afaec1587]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== disconnect_volume: return (404ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:29:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Deleting instance files /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8_del
Nov 15 11:29:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Deletion of /opt/stack/data/nova/instances/7220132d-4ce3-4dfb-b119-4bc6c163fcd8_del complete
Nov 15 11:29:28 user nova-compute[76049]: INFO nova.compute.manager [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 15 11:29:28 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:29:28 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:29:29 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:29:29 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Took 0.57 seconds to deallocate network for instance.
Nov 15 11:29:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-742e6a02-b8d7-4ace-8731-c2c8dcd64d13 req-75c66c73-b335-47d2-9069-81b09e434063 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:29:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-742e6a02-b8d7-4ace-8731-c2c8dcd64d13 req-75c66c73-b335-47d2-9069-81b09e434063 service nova] Acquiring lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:29:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-742e6a02-b8d7-4ace-8731-c2c8dcd64d13 req-75c66c73-b335-47d2-9069-81b09e434063 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:29:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-742e6a02-b8d7-4ace-8731-c2c8dcd64d13 req-75c66c73-b335-47d2-9069-81b09e434063 service nova] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:29:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-742e6a02-b8d7-4ace-8731-c2c8dcd64d13 req-75c66c73-b335-47d2-9069-81b09e434063 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] No waiting events found dispatching network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:29:29 user nova-compute[76049]: WARNING nova.compute.manager [req-742e6a02-b8d7-4ace-8731-c2c8dcd64d13 req-75c66c73-b335-47d2-9069-81b09e434063 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received unexpected event network-vif-plugged-8a1e98aa-536d-4e05-9833-e8c663128e8c for instance with vm_state active and task_state deleting.
Nov 15 11:29:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-742e6a02-b8d7-4ace-8731-c2c8dcd64d13 req-75c66c73-b335-47d2-9069-81b09e434063 service nova] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Received event network-vif-deleted-8a1e98aa-536d-4e05-9833-e8c663128e8c {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:29:30 user nova-compute[76049]: INFO nova.compute.manager [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 7220132d-4ce3-4dfb-b119-4bc6c163fcd8] Took 0.78 seconds to detach 1 volumes for instance.
Nov 15 11:29:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:29:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:29:30 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:29:30 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:29:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:29:30 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Deleted allocations for instance 7220132d-4ce3-4dfb-b119-4bc6c163fcd8
Nov 15 11:29:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-76ad1fa0-a42e-47e8-af93-f1dfa6bd8bb8 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "7220132d-4ce3-4dfb-b119-4bc6c163fcd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.255s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:29:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:29:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:29:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:29:34 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:29:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [{"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:29:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-25c772f6-5656-46b5-9461-d720314b29ae" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:29:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:29:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:29:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:37 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:29:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:40 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:43 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:29:43 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=24.937889099121094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance b3633502-a889-43a5-96df-ad92136e1231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 65cf42f2-4fc4-4e88-a78e-5a3babde37ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6426e887-3097-4c19-9340-cd1a76131216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 0a6400ee-9add-4632-ab9c-742951628122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fec692f0-8e23-450d-9537-759949ccf95f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:29:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:29:44 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:29:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:29:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:29:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:29:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:29:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:29:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:29:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:30:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:30:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:30:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "b3633502-a889-43a5-96df-ad92136e1231" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:18 user nova-compute[76049]: INFO nova.compute.manager [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Terminating instance
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-ab81f126-cccc-4ee8-be49-57e0de42369d req-227ce2a1-e6d8-463e-8d05-596bf980a2c9 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received event network-vif-unplugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ab81f126-cccc-4ee8-be49-57e0de42369d req-227ce2a1-e6d8-463e-8d05-596bf980a2c9 service nova] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ab81f126-cccc-4ee8-be49-57e0de42369d req-227ce2a1-e6d8-463e-8d05-596bf980a2c9 service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-ab81f126-cccc-4ee8-be49-57e0de42369d req-227ce2a1-e6d8-463e-8d05-596bf980a2c9 service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-ab81f126-cccc-4ee8-be49-57e0de42369d req-227ce2a1-e6d8-463e-8d05-596bf980a2c9 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] No waiting events found dispatching network-vif-unplugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-ab81f126-cccc-4ee8-be49-57e0de42369d req-227ce2a1-e6d8-463e-8d05-596bf980a2c9 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received event network-vif-unplugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: b3633502-a889-43a5-96df-ad92136e1231] Instance destroyed successfully.
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'resources' on Instance uuid b3633502-a889-43a5-96df-ad92136e1231 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1457574042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1457574042',id=35,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:21:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-xlc6vwt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:22:53Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=b3633502-a889-43a5-96df-ad92136e1231,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "address": "fa:16:3e:b9:ed:8c", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65e677e-4c", "ovs_interfaceid": "d65e677e-4c77-4fc4-bc40-521a9e3d63ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=d65e677e-4c77-4fc4-bc40-521a9e3d63ab,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65e677e-4c') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG os_vif [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=d65e677e-4c77-4fc4-bc40-521a9e3d63ab,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65e677e-4c') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd65e677e-4c, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7c00823-88fc-4018-9acf-8af215fec6ba) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:18 user nova-compute[76049]: INFO os_vif [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=d65e677e-4c77-4fc4-bc40-521a9e3d63ab,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65e677e-4c')
Nov 15 11:30:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Deleting instance files /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231_del
Nov 15 11:30:18 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Deletion of /opt/stack/data/nova/instances/b3633502-a889-43a5-96df-ad92136e1231_del complete
Nov 15 11:30:18 user nova-compute[76049]: INFO nova.compute.manager [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: b3633502-a889-43a5-96df-ad92136e1231] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 11:30:18 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: b3633502-a889-43a5-96df-ad92136e1231] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:30:18 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: b3633502-a889-43a5-96df-ad92136e1231] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:30:19 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: b3633502-a889-43a5-96df-ad92136e1231] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:30:19 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: b3633502-a889-43a5-96df-ad92136e1231] Took 0.43 seconds to deallocate network for instance.
Nov 15 11:30:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:19 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:30:19 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:30:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:19 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Deleted allocations for instance b3633502-a889-43a5-96df-ad92136e1231
Nov 15 11:30:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e909874b-c147-447a-a5a4-37ab25999973 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "b3633502-a889-43a5-96df-ad92136e1231" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.560s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-1a7d3792-f6ea-412c-9256-509dda036f39 req-2ba04259-a3fc-4755-abdf-9e4eb9c14883 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received event network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1a7d3792-f6ea-412c-9256-509dda036f39 req-2ba04259-a3fc-4755-abdf-9e4eb9c14883 service nova] Acquiring lock "b3633502-a889-43a5-96df-ad92136e1231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1a7d3792-f6ea-412c-9256-509dda036f39 req-2ba04259-a3fc-4755-abdf-9e4eb9c14883 service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1a7d3792-f6ea-412c-9256-509dda036f39 req-2ba04259-a3fc-4755-abdf-9e4eb9c14883 service nova] Lock "b3633502-a889-43a5-96df-ad92136e1231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-1a7d3792-f6ea-412c-9256-509dda036f39 req-2ba04259-a3fc-4755-abdf-9e4eb9c14883 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] No waiting events found dispatching network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:20 user nova-compute[76049]: WARNING nova.compute.manager [req-1a7d3792-f6ea-412c-9256-509dda036f39 req-2ba04259-a3fc-4755-abdf-9e4eb9c14883 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received unexpected event network-vif-plugged-d65e677e-4c77-4fc4-bc40-521a9e3d63ab for instance with vm_state deleted and task_state None.
Nov 15 11:30:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-1a7d3792-f6ea-412c-9256-509dda036f39 req-2ba04259-a3fc-4755-abdf-9e4eb9c14883 service nova] [instance: b3633502-a889-43a5-96df-ad92136e1231] Received event network-vif-deleted-d65e677e-4c77-4fc4-bc40-521a9e3d63ab {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-changed-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG nova.compute.manager [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Refreshing instance network info cache due to event network-changed-c20c2c5b-96b5-40fc-ad78-279421ee9df6. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] Acquiring lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] Acquired lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG nova.network.neutron [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Refreshing network info cache for port c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG nova.network.neutron [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updated VIF entry in instance network info cache for port c20c2c5b-96b5-40fc-ad78-279421ee9df6. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG nova.network.neutron [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updating instance_info_cache with network_info: [{"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:30:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-adf2e51e-bae2-4fdc-be8a-8a4d9432e687 req-71a6aec2-47d9-4f93-a526-6f29fbf76b48 service nova] Releasing lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "0a6400ee-9add-4632-ab9c-742951628122" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "0a6400ee-9add-4632-ab9c-742951628122" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "0a6400ee-9add-4632-ab9c-742951628122-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:23 user nova-compute[76049]: INFO nova.compute.manager [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Terminating instance
Nov 15 11:30:23 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Instance destroyed successfully.
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'resources' on Instance uuid 0a6400ee-9add-4632-ab9c-742951628122 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1508111719',display_name='tempest-TestVolumeBootPattern-server-1508111719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1508111719',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:28:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-m0fc7uic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:28:42Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=0a6400ee-9add-4632-ab9c-742951628122,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9f:93,bridge_name='br-int',has_traffic_filtering=True,id=c20c2c5b-96b5-40fc-ad78-279421ee9df6,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20c2c5b-96') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_vif [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9f:93,bridge_name='br-int',has_traffic_filtering=True,id=c20c2c5b-96b5-40fc-ad78-279421ee9df6,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20c2c5b-96') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc20c2c5b-96, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2379c78e-2514-4b49-92bf-f123938e2520) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:24 user nova-compute[76049]: INFO os_vif [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9f:93,bridge_name='br-int',has_traffic_filtering=True,id=c20c2c5b-96b5-40fc-ad78-279421ee9df6,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20c2c5b-96')
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxfYaIZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:30:24 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e98d506-8e17-40f4-af76-4ed69a79e559]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:30:24 user nova-compute[76049]: No targets found.
Nov 15 11:30:24 user nova-compute[76049]: iSNS:
Nov 15 11:30:24 user nova-compute[76049]: No targets found.
Nov 15 11:30:24 user nova-compute[76049]: STATIC:
Nov 15 11:30:24 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:30:24 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:30:24 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:30:24 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:30:24 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:30:24 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:30:24 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9
Nov 15 11:30:24 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:30:24 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:30:24 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:30:24 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:30:24 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:30:24 user nova-compute[76049]: FIRMWARE:
Nov 15 11:30:24 user nova-compute[76049]: No targets found.
Nov 15 11:30:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:30:24 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:30:24 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4f744-15fb-4ef0-8e93-f317bf505530]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e09143-629d-43af-bddd-cf01e0a8d869]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:30:24 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:30:24 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:30:24 user nova-compute[76049]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)
Nov 15 11:30:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:30:24 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:30:24 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:30:24 user nova-compute[76049]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 (non-flash)
Nov 15 11:30:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62606cf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0165c7f-4bd1-443f-ac67-ef9d30605834]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[694ae067-3746-40c6-a00c-fe90ddb8eeb7]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4112f01-9553-469a-b17a-588a2c5ed734]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b885aa-cf3f-4c07-8236-6420aa808261]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8a142bd-0bd33aabdd229629', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8a142bd', '/dev/disk/by-id/scsi-23062643333616162') {{(pid=85916) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f45c3c-99f0-4855-a192-e69b4936c645]: (4, None) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e20fb7d-6f3d-4442-aff7-897e587474da]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[739df352-5297-487e-a55b-8ba4add72bf7]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260]
Nov 15 11:30:24 user nova-compute[76049]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9, portal: 172.16.0.220,3260] successful.
Nov 15 11:30:24 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0b53e4-353a-4fbc-a019-7c00b32fc4b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2f53a9-a914-42e5-a916-a4261c57a157]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== disconnect_volume: return (315ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:30:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Deleting instance files /opt/stack/data/nova/instances/0a6400ee-9add-4632-ab9c-742951628122_del
Nov 15 11:30:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Deletion of /opt/stack/data/nova/instances/0a6400ee-9add-4632-ab9c-742951628122_del complete
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-changed-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Refreshing instance network info cache due to event network-changed-c20c2c5b-96b5-40fc-ad78-279421ee9df6. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Acquiring lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Acquired lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Refreshing network info cache for port c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:30:24 user nova-compute[76049]: INFO nova.compute.manager [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 0a6400ee-9add-4632-ab9c-742951628122] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updated VIF entry in instance network info cache for port c20c2c5b-96b5-40fc-ad78-279421ee9df6. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updating instance_info_cache with network_info: [{"id": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "address": "fa:16:3e:4f:9f:93", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20c2c5b-96", "ovs_interfaceid": "c20c2c5b-96b5-40fc-ad78-279421ee9df6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Releasing lock "refresh_cache-0a6400ee-9add-4632-ab9c-742951628122" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-vif-unplugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Acquiring lock "0a6400ee-9add-4632-ab9c-742951628122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] No waiting events found dispatching network-vif-unplugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-vif-unplugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Acquiring lock "0a6400ee-9add-4632-ab9c-742951628122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] Lock "0a6400ee-9add-4632-ab9c-742951628122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:24 user nova-compute[76049]: DEBUG nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] No waiting events found dispatching network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:24 user nova-compute[76049]: WARNING nova.compute.manager [req-d7fe79d2-0146-4330-ad11-5fddf9ebf21c req-ca260347-7e73-4ce9-bb3d-36b71e3ee01c service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received unexpected event network-vif-plugged-c20c2c5b-96b5-40fc-ad78-279421ee9df6 for instance with vm_state active and task_state deleting.
Nov 15 11:30:25 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:30:25 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Took 0.45 seconds to deallocate network for instance.
Nov 15 11:30:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-c42d0bed-7c86-4ec3-a5c6-d8d4beb520f2 req-fec3bc1d-6fd7-4802-9e07-91a6ea91286b service nova] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Received event network-vif-deleted-c20c2c5b-96b5-40fc-ad78-279421ee9df6 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:25 user nova-compute[76049]: INFO nova.compute.manager [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 0a6400ee-9add-4632-ab9c-742951628122] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 11:30:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:26 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:30:26 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:30:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:26 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Deleted allocations for instance 0a6400ee-9add-4632-ab9c-742951628122
Nov 15 11:30:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ff5d6d7b-d3ed-46b8-bc20-bee3bc0dc0f9 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "0a6400ee-9add-4632-ab9c-742951628122" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.897s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-changed-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Refreshing instance network info cache due to event network-changed-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:30:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] Acquiring lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:30:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] Acquired lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:30:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Refreshing network info cache for port 1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:30:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Updated VIF entry in instance network info cache for port 1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:30:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Updating instance_info_cache with network_info: [{"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:30:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-596738c3-7575-4376-a289-5317dea7290d req-771c0198-ecda-4e54-b7df-217fbbaf10c8 service nova] Releasing lock "refresh_cache-fec692f0-8e23-450d-9537-759949ccf95f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:30:30 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid fec692f0-8e23-450d-9537-759949ccf95f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:31 user nova-compute[76049]: INFO nova.compute.manager [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Attaching volume e73bc99e-383e-4806-9a08-bd455c83f0b6 to /dev/vdb
Nov 15 11:30:31 user nova-compute[76049]: DEBUG os_brick.utils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a734fb9b-2096-452a-9738-686189066640]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[529ce863-3f64-4dd4-9dc8-c87975f0df4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e2561b-c359-4eef-9669-f31b26ff5314]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f2bf26-9e2f-4427-9c80-edb2c65d1ea9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:30:31 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:30:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20e1d3d-7522-4dad-99fd-5234eb40e771]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG os_brick.utils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Updating existing volume attachment record: 55be311c-7c15-43b7-abef-885e1477d766 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:30:31 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating instance_info_cache with network_info: [{"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:30:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-8697e4ed-461e-4544-8137-faf180d111be" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:30:32 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:30:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:33 user nova-compute[76049]: INFO nova.compute.manager [None req-bf804d5b-8e8b-4e14-9bee-70147f7df828 tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Get console output
Nov 15 11:30:33 user nova-compute[76049]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 11:30:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:30:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:30:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyZkVQDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:30:36 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:30:36 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:30:36 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[412d2663-143f-4fc1-a16e-33655b48038b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:30:36 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d707293-c184-4aa6-a124-35ced3153c48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6] added
Nov 15 11:30:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73dcbc-1e9b-43fc-98ce-da8b70bb3d96]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef1b16-5bca-4cb2-a6a0-c82a23db6480]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wyZkVQDO {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wyZkVQDO" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[086820dc-0caf-420f-bca5-8594571e2c7e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wyZkVQDO'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e3018b-7920-428f-b43e-cad70c5313c0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd2b9a-2b50-4bad-a54b-5bd3f1f78e84]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692387e-2a8d-4823-9720-69a3cb990498]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260]
Nov 15 11:30:36 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260] successful.
Nov 15 11:30:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0d4c37-8652-40ff-836c-7f78b83e013f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1873b8b-e0f1-4524-ad05-1846cbc898dc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 (non-flash)
Nov 15 11:30:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:30:36 user nova-compute[76049]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 (non-flash)
Nov 15 11:30:36 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] HCTL ('36', '-', '-', 0) found on session 60 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbf4e00-ad05-419c-9891-668ae621ae69]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Searching for a device in session 60 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:30:36 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyZkVQDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:30:37 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:37 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:30:37 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23939323138316261', 'path': '/dev/sde'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:30:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939323138316261', 'path': '/dev/sde'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:30:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid fec692f0-8e23-450d-9537-759949ccf95f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:37 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:30:37 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:30:37 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:30:37 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:30:37 user nova-compute[76049]:   <serial>e73bc99e-383e-4806-9a08-bd455c83f0b6</serial>
Nov 15 11:30:37 user nova-compute[76049]: </disk>
Nov 15 11:30:37 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:30:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:30:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:30:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] No VIF found with MAC fa:16:3e:65:3c:5b, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:30:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-7380c2fe-b1ac-4b2e-938e-3a7196917546 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.790s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:39 user nova-compute[76049]: INFO nova.compute.manager [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Detaching volume e73bc99e-383e-4806-9a08-bd455c83f0b6
Nov 15 11:30:39 user nova-compute[76049]: INFO nova.virt.block_device [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Attempting to driver detach volume e73bc99e-383e-4806-9a08-bd455c83f0b6 from mountpoint /dev/vdb
Nov 15 11:30:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Attempting to detach device vdb from instance fec692f0-8e23-450d-9537-759949ccf95f from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:30:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:30:39 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:30:39 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:30:39 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:30:39 user nova-compute[76049]:   <serial>e73bc99e-383e-4806-9a08-bd455c83f0b6</serial>
Nov 15 11:30:39 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:30:39 user nova-compute[76049]: </disk>
Nov 15 11:30:39 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:30:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully detached device vdb from instance fec692f0-8e23-450d-9537-759949ccf95f from the persistent domain config.
Nov 15 11:30:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fec692f0-8e23-450d-9537-759949ccf95f from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:30:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:30:39 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:30:39 user nova-compute[76049]:   <source dev="/dev/sde"/>
Nov 15 11:30:39 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:30:39 user nova-compute[76049]:   <serial>e73bc99e-383e-4806-9a08-bd455c83f0b6</serial>
Nov 15 11:30:39 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:30:39 user nova-compute[76049]: </disk>
Nov 15 11:30:39 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:30:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fec692f0-8e23-450d-9537-759949ccf95f {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:30:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:41 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:30:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=25.04492950439453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8697e4ed-461e-4544-8137-faf180d111be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 65cf42f2-4fc4-4e88-a78e-5a3babde37ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6426e887-3097-4c19-9340-cd1a76131216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fec692f0-8e23-450d-9537-759949ccf95f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:30:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:30:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:56 user nova-compute[76049]: INFO nova.compute.manager [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Rescuing
Nov 15 11:30:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:30:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:30:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:30:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:30:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:30:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-a67c4b54-a059-45f6-9f33-9f6eb3d8c1c2 req-82490e29-524b-4b24-b669-e827c627b60b service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a67c4b54-a059-45f6-9f33-9f6eb3d8c1c2 req-82490e29-524b-4b24-b669-e827c627b60b service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a67c4b54-a059-45f6-9f33-9f6eb3d8c1c2 req-82490e29-524b-4b24-b669-e827c627b60b service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a67c4b54-a059-45f6-9f33-9f6eb3d8c1c2 req-82490e29-524b-4b24-b669-e827c627b60b service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-a67c4b54-a059-45f6-9f33-9f6eb3d8c1c2 req-82490e29-524b-4b24-b669-e827c627b60b service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:57 user nova-compute[76049]: WARNING nova.compute.manager [req-a67c4b54-a059-45f6-9f33-9f6eb3d8c1c2 req-82490e29-524b-4b24-b669-e827c627b60b service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state active and task_state rescuing.
Nov 15 11:30:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance destroyed successfully.
Nov 15 11:30:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Attempting rescue
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76049) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:30:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Creating image(s)
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'trusted_certs' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue" returned: 0 in 0.051s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'migration_context' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.base [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<abc51297-8f1e-46d6-b1ae-843c34d7cbf3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Start _get_guest_xml network_info=[{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:36:70:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'resources' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.base [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<abc51297-8f1e-46d6-b1ae-843c34d7cbf3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'numa_topology' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.base [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<abc51297-8f1e-46d6-b1ae-843c34d7cbf3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:30:57 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:30:57 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'vcpu_model' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.base [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<abc51297-8f1e-46d6-b1ae-843c34d7cbf3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674425469',display_name='tempest-ServerRescueNegativeTestJSON-server-674425469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674425469',id=43,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-tmhj757s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:26:21Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=abc51297-8f1e-46d6-b1ae-843c34d7cbf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:36:70:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:36:70:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'pci_devices' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.objects.base [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<abc51297-8f1e-46d6-b1ae-843c34d7cbf3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:30:57 user nova-compute[76049]:   <uuid>abc51297-8f1e-46d6-b1ae-843c34d7cbf3</uuid>
Nov 15 11:30:57 user nova-compute[76049]:   <name>instance-0000002b</name>
Nov 15 11:30:57 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:30:57 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:30:57 user nova-compute[76049]:   <metadata>
Nov 15 11:30:57 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:30:57 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:30:57 user nova-compute[76049]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674425469</nova:name>
Nov 15 11:30:57 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:30:57</nova:creationTime>
Nov 15 11:30:57 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:30:57 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:30:57 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:30:57 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:30:57 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:30:57 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:30:57 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:30:57 user nova-compute[76049]:       <nova:owner>
Nov 15 11:30:57 user nova-compute[76049]:         <nova:user uuid="ab6a364f470c402bbd91712302c611cd">tempest-ServerRescueNegativeTestJSON-47045426-project-member</nova:user>
Nov 15 11:30:57 user nova-compute[76049]:         <nova:project uuid="fde1d2d3e99a4c96ab95220df3de4ad4">tempest-ServerRescueNegativeTestJSON-47045426</nova:project>
Nov 15 11:30:57 user nova-compute[76049]:       </nova:owner>
Nov 15 11:30:57 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:30:57 user nova-compute[76049]:       <nova:ports>
Nov 15 11:30:57 user nova-compute[76049]:         <nova:port uuid="edd140bd-2737-4f7c-b54c-d59a6a2d7ddb">
Nov 15 11:30:57 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 11:30:57 user nova-compute[76049]:         </nova:port>
Nov 15 11:30:57 user nova-compute[76049]:       </nova:ports>
Nov 15 11:30:57 user nova-compute[76049]:     </nova:instance>
Nov 15 11:30:57 user nova-compute[76049]:   </metadata>
Nov 15 11:30:57 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:30:57 user nova-compute[76049]:     <system>
Nov 15 11:30:57 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:30:57 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:30:57 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:30:57 user nova-compute[76049]:       <entry name="serial">abc51297-8f1e-46d6-b1ae-843c34d7cbf3</entry>
Nov 15 11:30:57 user nova-compute[76049]:       <entry name="uuid">abc51297-8f1e-46d6-b1ae-843c34d7cbf3</entry>
Nov 15 11:30:57 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:30:57 user nova-compute[76049]:     </system>
Nov 15 11:30:57 user nova-compute[76049]:   </sysinfo>
Nov 15 11:30:57 user nova-compute[76049]:   <os>
Nov 15 11:30:57 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:30:57 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:30:57 user nova-compute[76049]:   </os>
Nov 15 11:30:57 user nova-compute[76049]:   <features>
Nov 15 11:30:57 user nova-compute[76049]:     <acpi/>
Nov 15 11:30:57 user nova-compute[76049]:     <apic/>
Nov 15 11:30:57 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:30:57 user nova-compute[76049]:   </features>
Nov 15 11:30:57 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:30:57 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:30:57 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:30:57 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:30:57 user nova-compute[76049]:   </clock>
Nov 15 11:30:57 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:30:57 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:30:57 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:30:57 user nova-compute[76049]:   </cpu>
Nov 15 11:30:57 user nova-compute[76049]:   <devices>
Nov 15 11:30:57 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:30:57 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:30:57 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue"/>
Nov 15 11:30:57 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:30:57 user nova-compute[76049]:     </disk>
Nov 15 11:30:57 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:30:57 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:30:57 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk"/>
Nov 15 11:30:57 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:30:57 user nova-compute[76049]:     </disk>
Nov 15 11:30:57 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:30:57 user nova-compute[76049]:       <mac address="fa:16:3e:36:70:c7"/>
Nov 15 11:30:57 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:30:57 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:30:57 user nova-compute[76049]:       <target dev="tapedd140bd-27"/>
Nov 15 11:30:57 user nova-compute[76049]:     </interface>
Nov 15 11:30:57 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:30:57 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/console.log" append="off"/>
Nov 15 11:30:57 user nova-compute[76049]:     </serial>
Nov 15 11:30:57 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:30:57 user nova-compute[76049]:     <video>
Nov 15 11:30:57 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:30:57 user nova-compute[76049]:     </video>
Nov 15 11:30:57 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:30:57 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:30:57 user nova-compute[76049]:     </rng>
Nov 15 11:30:57 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:30:57 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:30:57 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:30:57 user nova-compute[76049]:     </memballoon>
Nov 15 11:30:57 user nova-compute[76049]:   </devices>
Nov 15 11:30:57 user nova-compute[76049]: </domain>
Nov 15 11:30:57 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:30:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance destroyed successfully.
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:30:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No VIF found with MAC fa:16:3e:36:70:c7, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:30:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:59 user nova-compute[76049]: WARNING nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state active and task_state rescuing.
Nov 15 11:30:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:59 user nova-compute[76049]: WARNING nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state active and task_state rescuing.
Nov 15 11:30:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:30:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:30:59 user nova-compute[76049]: WARNING nova.compute.manager [req-c31cef01-4ab6-4b46-a7de-a51607dfe8df req-a711f5d7-1721-41fa-b286-c81701db8c62 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state active and task_state rescuing.
Nov 15 11:31:00 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fec692f0-8e23-450d-9537-759949ccf95f is timed out.
Nov 15 11:31:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully detached device vdb from instance fec692f0-8e23-450d-9537-759949ccf95f from the live domain config.
Nov 15 11:31:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyZkVQDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:31:00 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b48b1a-dd9b-4a6a-851b-b97fa821f8a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:31:00 user nova-compute[76049]: No targets found.
Nov 15 11:31:00 user nova-compute[76049]: iSNS:
Nov 15 11:31:00 user nova-compute[76049]: No targets found.
Nov 15 11:31:00 user nova-compute[76049]: STATIC:
Nov 15 11:31:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:31:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:31:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6
Nov 15 11:31:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:00 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:31:00 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:00 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:00 user nova-compute[76049]: FIRMWARE:
Nov 15 11:31:00 user nova-compute[76049]: No targets found.
Nov 15 11:31:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:31:00 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:31:00 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[078df9cc-c8f1-415f-b4a5-ae2224e49b75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0d974-8bb0-486d-8287-05e6f501d485]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:31:00 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:31:00 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:00 user nova-compute[76049]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 (non-flash)
Nov 15 11:31:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:31:00 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:31:00 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:00 user nova-compute[76049]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 (non-flash)
Nov 15 11:31:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607ad510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6'): ({'sde'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Removing single pathed devices sde {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[195e8fb2-cf61-4d5f-ae85-54d87d111afd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb5cca7-10c2-4523-b25e-ed7b5dd097b8]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Flushing IO for device /dev/sde {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[18037407-bd86-4068-a6f3-73456645e02c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b176e-a1f2-4a23-a5e0-1aeada3a0a31]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] SCSI volumes sde have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ab2c1-41a2-475a-a77b-2ef7a34ab124]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6c23b-e150-417d-aa40-5b496d2ef310]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260]
Nov 15 11:31:00 user nova-compute[76049]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6, portal: 172.16.0.220,3260] successful.
Nov 15 11:31:00 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73bc99e-383e-4806-9a08-bd455c83f0b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[340ae8c7-1dc3-4afa-92c7-479b5f6fa0bc]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] <== disconnect_volume: return (295ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:31:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:31:01 user nova-compute[76049]: DEBUG nova.compute.manager [None req-3fc53593-334f-44a4-87c8-f7ac393e5629 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:31:01 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'flavor' on Instance uuid fec692f0-8e23-450d-9537-759949ccf95f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:31:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6487c295-5331-4e87-8847-d768602a4e02 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "8697e4ed-461e-4544-8137-faf180d111be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:08 user nova-compute[76049]: INFO nova.compute.manager [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Terminating instance
Nov 15 11:31:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:31:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-a2309534-81a7-47fd-bb1d-879c7a240ca3 req-f3b34e13-801e-4ae3-8de7-730ff59ee926 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a2309534-81a7-47fd-bb1d-879c7a240ca3 req-f3b34e13-801e-4ae3-8de7-730ff59ee926 service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a2309534-81a7-47fd-bb1d-879c7a240ca3 req-f3b34e13-801e-4ae3-8de7-730ff59ee926 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a2309534-81a7-47fd-bb1d-879c7a240ca3 req-f3b34e13-801e-4ae3-8de7-730ff59ee926 service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-a2309534-81a7-47fd-bb1d-879c7a240ca3 req-f3b34e13-801e-4ae3-8de7-730ff59ee926 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.compute.manager [req-a2309534-81a7-47fd-bb1d-879c7a240ca3 req-f3b34e13-801e-4ae3-8de7-730ff59ee926 service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-unplugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Instance destroyed successfully.
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.objects.instance [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'resources' on Instance uuid 8697e4ed-461e-4544-8137-faf180d111be {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033587775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033587775',id=24,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-05c01rg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:19:08Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=8697e4ed-461e-4544-8137-faf180d111be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "address": "fa:16:3e:7a:32:13", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec20e73-a1", "ovs_interfaceid": "4ec20e73-a139-4cb2-82ac-524d080ad9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_vif [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ec20e73-a1, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d367fecb-72a5-4486-86d2-e639d811eecd) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:31:09 user nova-compute[76049]: INFO os_vif [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:32:13,bridge_name='br-int',has_traffic_filtering=True,id=4ec20e73-a139-4cb2-82ac-524d080ad9e9,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec20e73-a1')
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUPLSYyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:31:09 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e448b-3ab9-43c1-8025-ce212cec38b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:31:09 user nova-compute[76049]: No targets found.
Nov 15 11:31:09 user nova-compute[76049]: iSNS:
Nov 15 11:31:09 user nova-compute[76049]: No targets found.
Nov 15 11:31:09 user nova-compute[76049]: STATIC:
Nov 15 11:31:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:31:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:31:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:09 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c
Nov 15 11:31:09 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:09 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:09 user nova-compute[76049]: FIRMWARE:
Nov 15 11:31:09 user nova-compute[76049]: No targets found.
Nov 15 11:31:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:31:09 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:31:09 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[39069268-dc22-4b63-a4f5-06dbdb6a6c79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8ae147-5f1a-4e85-a04a-1289960cdcb6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:31:09 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:31:09 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c (non-flash)
Nov 15 11:31:09 user nova-compute[76049]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:31:09 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629c1249d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c'): ({'sdd'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Removing single pathed devices sdd {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c856733f-4b64-457f-b9e0-3ee984c935dc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[601a74af-5a85-4782-97b4-1b1c7b911998]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Flushing IO for device /dev/sdd {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f9771-79a8-4805-aea3-b5c91b672e7d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f939d-6632-4b9c-9227-9238516d79b2]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] SCSI volumes sdd have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd9453d-07c2-4386-adce-b8545417f58c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9033279-0392-44d7-8608-c1c681d62048]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260]
Nov 15 11:31:09 user nova-compute[76049]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c, portal: 172.16.0.220,3260] successful.
Nov 15 11:31:09 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f1c736-d603-4f9c-97da-630cc3e0f18c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be9f057-a131-43b4-aea0-202c64bdebe1]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] <== disconnect_volume: return (300ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:31:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Deleting instance files /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be_del
Nov 15 11:31:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Deletion of /opt/stack/data/nova/instances/8697e4ed-461e-4544-8137-faf180d111be_del complete
Nov 15 11:31:09 user nova-compute[76049]: INFO nova.compute.manager [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 15 11:31:09 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:31:09 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:31:10 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:31:10 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Took 0.39 seconds to deallocate network for instance.
Nov 15 11:31:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-970dbdeb-ce24-4572-8736-12523a12698b req-d48b4eaa-dd1e-412a-8a7a-de3669c75e2c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-970dbdeb-ce24-4572-8736-12523a12698b req-d48b4eaa-dd1e-412a-8a7a-de3669c75e2c service nova] Acquiring lock "8697e4ed-461e-4544-8137-faf180d111be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-970dbdeb-ce24-4572-8736-12523a12698b req-d48b4eaa-dd1e-412a-8a7a-de3669c75e2c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-970dbdeb-ce24-4572-8736-12523a12698b req-d48b4eaa-dd1e-412a-8a7a-de3669c75e2c service nova] Lock "8697e4ed-461e-4544-8137-faf180d111be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-970dbdeb-ce24-4572-8736-12523a12698b req-d48b4eaa-dd1e-412a-8a7a-de3669c75e2c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] No waiting events found dispatching network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:11 user nova-compute[76049]: WARNING nova.compute.manager [req-970dbdeb-ce24-4572-8736-12523a12698b req-d48b4eaa-dd1e-412a-8a7a-de3669c75e2c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received unexpected event network-vif-plugged-4ec20e73-a139-4cb2-82ac-524d080ad9e9 for instance with vm_state active and task_state deleting.
Nov 15 11:31:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-970dbdeb-ce24-4572-8736-12523a12698b req-d48b4eaa-dd1e-412a-8a7a-de3669c75e2c service nova] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Received event network-vif-deleted-4ec20e73-a139-4cb2-82ac-524d080ad9e9 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:11 user nova-compute[76049]: INFO nova.compute.manager [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: 8697e4ed-461e-4544-8137-faf180d111be] Took 1.06 seconds to detach 1 volumes for instance.
Nov 15 11:31:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:31:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:11 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Deleted allocations for instance 8697e4ed-461e-4544-8137-faf180d111be
Nov 15 11:31:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-081ce67b-eefe-4cef-b905-0473487c75d4 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "8697e4ed-461e-4544-8137-faf180d111be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.025s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-changed-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG nova.compute.manager [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Refreshing instance network info cache due to event network-changed-ebc8de16-4b06-4f6c-af63-452043a5401a. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] Acquiring lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] Acquired lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG nova.network.neutron [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Refreshing network info cache for port ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:18 user nova-compute[76049]: INFO nova.compute.manager [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Terminating instance
Nov 15 11:31:18 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-01f6d7c9-e03b-4aec-992c-61574ae3b4c8 req-6c5e5fa5-06d7-4759-8cc8-510b16322681 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-unplugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-01f6d7c9-e03b-4aec-992c-61574ae3b4c8 req-6c5e5fa5-06d7-4759-8cc8-510b16322681 service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-01f6d7c9-e03b-4aec-992c-61574ae3b4c8 req-6c5e5fa5-06d7-4759-8cc8-510b16322681 service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-01f6d7c9-e03b-4aec-992c-61574ae3b4c8 req-6c5e5fa5-06d7-4759-8cc8-510b16322681 service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-01f6d7c9-e03b-4aec-992c-61574ae3b4c8 req-6c5e5fa5-06d7-4759-8cc8-510b16322681 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-unplugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.compute.manager [req-01f6d7c9-e03b-4aec-992c-61574ae3b4c8 req-6c5e5fa5-06d7-4759-8cc8-510b16322681 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-unplugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updated VIF entry in instance network info cache for port ebc8de16-4b06-4f6c-af63-452043a5401a. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.network.neutron [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updating instance_info_cache with network_info: [{"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6f786882-169f-47bb-b91e-fa31c8b02416 req-7a4c7c07-8e2d-4192-870a-0c97c8686003 service nova] Releasing lock "refresh_cache-65cf42f2-4fc4-4e88-a78e-5a3babde37ec" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Instance destroyed successfully.
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lazy-loading 'resources' on Instance uuid 65cf42f2-4fc4-4e88-a78e-5a3babde37ec {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-865644559',display_name='tempest-TestVolumeBootPattern-server-865644559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-865644559',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqZ2TpvT4gVTrtYKQWKMu46ORdrg+4Y7mOOvL9/60PEwortoNJ758YVPzbOh/khlVUFSaiozctSezpqn+mEotrHGMAVSRAIacAMvPf6Y1dIe06Gt0wIyAKBgEnhWVpKEg==',key_name='tempest-TestVolumeBootPattern-252984423',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0917737287484e2498e2dcf616b8679e',ramdisk_id='',reservation_id='r-ndkg0omq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2118546811',owner_user_name='tempest-TestVolumeBootPattern-2118546811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:26:45Z,user_data=None,user_id='ac7d77f50629413bb7b6c9457156af67',uuid=65cf42f2-4fc4-4e88-a78e-5a3babde37ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converting VIF {"id": "ebc8de16-4b06-4f6c-af63-452043a5401a", "address": "fa:16:3e:56:b9:ea", "network": {"id": "e1691051-d589-41de-baae-4131b030872d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-717417548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0917737287484e2498e2dcf616b8679e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8de16-4b", "ovs_interfaceid": "ebc8de16-4b06-4f6c-af63-452043a5401a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=ebc8de16-4b06-4f6c-af63-452043a5401a,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8de16-4b') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_vif [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=ebc8de16-4b06-4f6c-af63-452043a5401a,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8de16-4b') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebc8de16-4b, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6427569-774d-4357-bc64-e8c89cdefc39) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:19 user nova-compute[76049]: INFO os_vif [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=ebc8de16-4b06-4f6c-af63-452043a5401a,network=Network(e1691051-d589-41de-baae-4131b030872d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8de16-4b')
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxYZWrjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:31:19 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d682eeb-3ba7-4f6f-aa76-e8fc34be3e88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:31:19 user nova-compute[76049]: No targets found.
Nov 15 11:31:19 user nova-compute[76049]: iSNS:
Nov 15 11:31:19 user nova-compute[76049]: No targets found.
Nov 15 11:31:19 user nova-compute[76049]: STATIC:
Nov 15 11:31:19 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:31:19 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:19 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:19 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852
Nov 15 11:31:19 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:19 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:19 user nova-compute[76049]: FIRMWARE:
Nov 15 11:31:19 user nova-compute[76049]: No targets found.
Nov 15 11:31:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:31:19 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:31:19 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a1af1f-428b-4b09-b768-04ca2661a3f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dca686-cd0b-4348-89c3-08e9761a0d5b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:31:19 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 (non-flash)
Nov 15 11:31:19 user nova-compute[76049]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62604fc8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d22126-a1f3-4e81-957e-a02af0d2f495]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d57b5-d2ab-457b-ae32-b4a53c3d746f]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1ac972-c3bf-4c82-9aa4-f487c8504438]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6d25e-8b13-4d34-ada5-09973da46788]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[211307c1-d3c8-4b3c-a7e7-631fdf4c1c3e]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[873e230f-1094-47db-af72-915e982953cd]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260]
Nov 15 11:31:19 user nova-compute[76049]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852, portal: 172.16.0.220,3260] successful.
Nov 15 11:31:19 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22cc816-8326-4fe4-9f15-fb71fcd10852 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[382e38eb-bddd-4ea8-bf1c-c82b663f41b8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] <== disconnect_volume: return (361ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:31:19 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:31:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Deleting instance files /opt/stack/data/nova/instances/65cf42f2-4fc4-4e88-a78e-5a3babde37ec_del
Nov 15 11:31:19 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Deletion of /opt/stack/data/nova/instances/65cf42f2-4fc4-4e88-a78e-5a3babde37ec_del complete
Nov 15 11:31:20 user nova-compute[76049]: INFO nova.compute.manager [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 11:31:20 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:31:20 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Took 0.43 seconds to deallocate network for instance.
Nov 15 11:31:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f71db70f-bea9-4e77-8632-3afde884436b req-23213012-0738-4426-b840-f51035e38802 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-deleted-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:20 user nova-compute[76049]: INFO nova.compute.manager [req-f71db70f-bea9-4e77-8632-3afde884436b req-23213012-0738-4426-b840-f51035e38802 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Neutron deleted interface ebc8de16-4b06-4f6c-af63-452043a5401a; detaching it from the instance and deleting it from the info cache
Nov 15 11:31:20 user nova-compute[76049]: DEBUG nova.network.neutron [req-f71db70f-bea9-4e77-8632-3afde884436b req-23213012-0738-4426-b840-f51035e38802 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:31:20 user nova-compute[76049]: DEBUG nova.compute.manager [req-f71db70f-bea9-4e77-8632-3afde884436b req-23213012-0738-4426-b840-f51035e38802 service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Detach interface failed, port_id=ebc8de16-4b06-4f6c-af63-452043a5401a, reason: Instance 65cf42f2-4fc4-4e88-a78e-5a3babde37ec could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:21 user nova-compute[76049]: WARNING nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received unexpected event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with vm_state active and task_state deleting.
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:21 user nova-compute[76049]: WARNING nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received unexpected event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with vm_state active and task_state deleting.
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:21 user nova-compute[76049]: WARNING nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received unexpected event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with vm_state active and task_state deleting.
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-unplugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-unplugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-unplugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Acquiring lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] No waiting events found dispatching network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:21 user nova-compute[76049]: WARNING nova.compute.manager [req-bc57103b-0211-4cc7-8e87-012e8b9bc988 req-716ab339-ee43-45fe-99f4-015d744fabfb service nova] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Received unexpected event network-vif-plugged-ebc8de16-4b06-4f6c-af63-452043a5401a for instance with vm_state active and task_state deleting.
Nov 15 11:31:21 user nova-compute[76049]: INFO nova.compute.manager [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] [instance: 65cf42f2-4fc4-4e88-a78e-5a3babde37ec] Took 0.82 seconds to detach 1 volumes for instance.
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:21 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Deleted allocations for instance 65cf42f2-4fc4-4e88-a78e-5a3babde37ec
Nov 15 11:31:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a8c2955-8e91-42b2-a90a-a802e61f34f2 tempest-TestVolumeBootPattern-2118546811 tempest-TestVolumeBootPattern-2118546811-project-member] Lock "65cf42f2-4fc4-4e88-a78e-5a3babde37ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.894s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:30 user nova-compute[76049]: INFO nova.compute.manager [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Terminating instance
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.compute.manager [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-2bb17494-b936-4e0a-9231-d4ff5bf96415 req-efd7ce76-f69c-4f96-9abf-8e0182ebfaa2 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-vif-unplugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2bb17494-b936-4e0a-9231-d4ff5bf96415 req-efd7ce76-f69c-4f96-9abf-8e0182ebfaa2 service nova] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2bb17494-b936-4e0a-9231-d4ff5bf96415 req-efd7ce76-f69c-4f96-9abf-8e0182ebfaa2 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2bb17494-b936-4e0a-9231-d4ff5bf96415 req-efd7ce76-f69c-4f96-9abf-8e0182ebfaa2 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-2bb17494-b936-4e0a-9231-d4ff5bf96415 req-efd7ce76-f69c-4f96-9abf-8e0182ebfaa2 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] No waiting events found dispatching network-vif-unplugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-2bb17494-b936-4e0a-9231-d4ff5bf96415 req-efd7ce76-f69c-4f96-9abf-8e0182ebfaa2 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-vif-unplugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:31:30 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Instance destroyed successfully.
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lazy-loading 'resources' on Instance uuid fec692f0-8e23-450d-9537-759949ccf95f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-644996162',display_name='tempest-AttachVolumeNegativeTest-server-644996162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-644996162',id=47,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsO9u7SHhwq2Det3zPhVYULaVuSn8JcfA6ujGkhi2ZxlUhW7nHKDmDpvO8XCVHzWziaM018YbcvbLVNadUUw79rUw8BIP+QJcCMsAYIpkoTRhKeNeRRN0j3T/3nwAQaKQ==',key_name='tempest-keypair-1289936094',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:28:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d20305cc32b4da29ebe034a326e401e',ramdisk_id='',reservation_id='r-lnggc696',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136408759',owner_user_name='tempest-AttachVolumeNegativeTest-2136408759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3405f82948e641e685ecccb007c4c60d',uuid=fec692f0-8e23-450d-9537-759949ccf95f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converting VIF {"id": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "address": "fa:16:3e:65:3c:5b", "network": {"id": "d4aa30ad-b616-47bc-8b20-168bed18039e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1020275146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d20305cc32b4da29ebe034a326e401e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fcc8f-11", "ovs_interfaceid": "1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:3c:5b,bridge_name='br-int',has_traffic_filtering=True,id=1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fcc8f-11') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG os_vif [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:3c:5b,bridge_name='br-int',has_traffic_filtering=True,id=1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fcc8f-11') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f6fcc8f-11, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40a3c5ae-6d32-4b6b-afec-54b6e3f7abbe) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:31:30 user nova-compute[76049]: INFO os_vif [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:3c:5b,bridge_name='br-int',has_traffic_filtering=True,id=1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f,network=Network(d4aa30ad-b616-47bc-8b20-168bed18039e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fcc8f-11')
Nov 15 11:31:30 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Deleting instance files /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f_del
Nov 15 11:31:30 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Deletion of /opt/stack/data/nova/instances/fec692f0-8e23-450d-9537-759949ccf95f_del complete
Nov 15 11:31:30 user nova-compute[76049]: INFO nova.compute.manager [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 11:31:30 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:31:30 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: fec692f0-8e23-450d-9537-759949ccf95f] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:31:32 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Took 1.16 seconds to deallocate network for instance.
Nov 15 11:31:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:32 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Deleted allocations for instance fec692f0-8e23-450d-9537-759949ccf95f
Nov 15 11:31:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0f4c8ccf-a33c-48ae-8825-f45288a83839 tempest-AttachVolumeNegativeTest-2136408759 tempest-AttachVolumeNegativeTest-2136408759-project-member] Lock "fec692f0-8e23-450d-9537-759949ccf95f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-f0118b0a-ea19-4bf7-a964-757756509938 req-87fc62ed-a3cd-4484-ba42-749f9dafbd41 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f0118b0a-ea19-4bf7-a964-757756509938 req-87fc62ed-a3cd-4484-ba42-749f9dafbd41 service nova] Acquiring lock "fec692f0-8e23-450d-9537-759949ccf95f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f0118b0a-ea19-4bf7-a964-757756509938 req-87fc62ed-a3cd-4484-ba42-749f9dafbd41 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f0118b0a-ea19-4bf7-a964-757756509938 req-87fc62ed-a3cd-4484-ba42-749f9dafbd41 service nova] Lock "fec692f0-8e23-450d-9537-759949ccf95f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-f0118b0a-ea19-4bf7-a964-757756509938 req-87fc62ed-a3cd-4484-ba42-749f9dafbd41 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] No waiting events found dispatching network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:32 user nova-compute[76049]: WARNING nova.compute.manager [req-f0118b0a-ea19-4bf7-a964-757756509938 req-87fc62ed-a3cd-4484-ba42-749f9dafbd41 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received unexpected event network-vif-plugged-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f for instance with vm_state deleted and task_state None.
Nov 15 11:31:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-f0118b0a-ea19-4bf7-a964-757756509938 req-87fc62ed-a3cd-4484-ba42-749f9dafbd41 service nova] [instance: fec692f0-8e23-450d-9537-759949ccf95f] Received event network-vif-deleted-1f6fcc8f-11bc-4c6b-a89a-f4b7df0ea09f {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:33 user nova-compute[76049]: INFO nova.compute.manager [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Terminating instance
Nov 15 11:31:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-unplugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-unplugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-unplugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] Acquiring lock "6426e887-3097-4c19-9340-cd1a76131216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] Lock "6426e887-3097-4c19-9340-cd1a76131216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] No waiting events found dispatching network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:34 user nova-compute[76049]: WARNING nova.compute.manager [req-433ed52c-7d7d-42f3-b781-9947eec54d68 req-f0d07f1f-cfb2-44ca-8cb8-2ba19188a5f6 service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received unexpected event network-vif-plugged-3f38a8ea-3588-47c3-a10d-7f4787fe629d for instance with vm_state active and task_state deleting.
Nov 15 11:31:34 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Instance destroyed successfully.
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'resources' on Instance uuid 6426e887-3097-4c19-9340-cd1a76131216 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1578483471',display_name='tempest-ServerActionsTestOtherA-server-1578483471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1578483471',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:27:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-mjy54lb4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=6426e887-3097-4c19-9340-cd1a76131216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "address": "fa:16:3e:a2:84:1d", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f38a8ea-35", "ovs_interfaceid": "3f38a8ea-3588-47c3-a10d-7f4787fe629d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_vif [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f38a8ea-35, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e89a8db5-10a3-4d6f-8ae4-c37489c28233) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:34 user nova-compute[76049]: INFO os_vif [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:84:1d,bridge_name='br-int',has_traffic_filtering=True,id=3f38a8ea-3588-47c3-a10d-7f4787fe629d,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f38a8ea-35')
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVyTKng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:31:34 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a3c04a-6a16-462c-858c-5584951d386d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:31:34 user nova-compute[76049]: No targets found.
Nov 15 11:31:34 user nova-compute[76049]: iSNS:
Nov 15 11:31:34 user nova-compute[76049]: No targets found.
Nov 15 11:31:34 user nova-compute[76049]: STATIC:
Nov 15 11:31:34 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c
Nov 15 11:31:34 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:31:34 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:31:34 user nova-compute[76049]: FIRMWARE:
Nov 15 11:31:34 user nova-compute[76049]: No targets found.
Nov 15 11:31:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:31:34 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:31:34 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1265a8b2-f1cd-4a7d-964a-138c3e61c769]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a4a79e-ff32-4436-bfaf-fb78c216a5cc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c (non-flash)
Nov 15 11:31:34 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842ba440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c'): ({'sdc'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Removing single pathed devices sdc {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc22cb1-756b-4272-ac19-776fdcf036b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd8450c-3d33-4230-b5f0-d5265709c167]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Flushing IO for device /dev/sdc {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db0c4c-69b9-4087-8e59-6fbbf85e959d]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6a2af1-ae8a-43bb-ac4c-24bf1f27e0a2]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] SCSI volumes sdc have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe7cc0f-9668-4121-8e5c-ae5af928ac3b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:34 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef74a84-908b-45cb-94f7-b08971def7ca]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260]
Nov 15 11:31:35 user nova-compute[76049]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c, portal: 172.16.0.220,3260] successful.
Nov 15 11:31:35 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Skipping network cache update for instance because it is being deleted. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64321a7-fb06-4edb-ab36-3478e8c76d7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3493e1c0-009f-4608-9a25-030e284dfc93]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] <== disconnect_volume: return (283ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:31:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Deleting instance files /opt/stack/data/nova/instances/6426e887-3097-4c19-9340-cd1a76131216_del
Nov 15 11:31:35 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Deletion of /opt/stack/data/nova/instances/6426e887-3097-4c19-9340-cd1a76131216_del complete
Nov 15 11:31:35 user nova-compute[76049]: INFO nova.compute.manager [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:31:35 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Took 0.67 seconds to deallocate network for instance.
Nov 15 11:31:35 user nova-compute[76049]: DEBUG nova.compute.manager [req-98d3765f-f8ce-4a9a-a43d-8b63912ff083 req-2b4a5a6d-8c00-49df-afd5-6d5b4a3db41b service nova] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Received event network-vif-deleted-3f38a8ea-3588-47c3-a10d-7f4787fe629d {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:36 user nova-compute[76049]: INFO nova.compute.manager [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Took 0.76 seconds to detach 1 volumes for instance.
Nov 15 11:31:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 6426e887-3097-4c19-9340-cd1a76131216] Deleting volume: c64321a7-fb06-4edb-ab36-3478e8c76d7c {{(pid=76049) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 11:31:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:36 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:31:36 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:31:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:36 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Deleted allocations for instance 6426e887-3097-4c19-9340-cd1a76131216
Nov 15 11:31:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6dd6674c-0745-4185-a284-62e68360337e tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "6426e887-3097-4c19-9340-cd1a76131216" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.034s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:31:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:31:45 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:31:45 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=25.062274932861328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 25c772f6-5656-46b5-9461-d720314b29ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:31:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:31:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:31:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:31:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:31:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:31:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:59 user nova-compute[76049]: INFO nova.compute.manager [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Terminating instance
Nov 15 11:31:59 user nova-compute[76049]: DEBUG nova.compute.manager [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb7bca3e-fd5f-457e-92b8-70c55f78b8c9 req-fbfed560-9c34-415c-a5da-12c6e336dd4c service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received event network-vif-unplugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb7bca3e-fd5f-457e-92b8-70c55f78b8c9 req-fbfed560-9c34-415c-a5da-12c6e336dd4c service nova] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb7bca3e-fd5f-457e-92b8-70c55f78b8c9 req-fbfed560-9c34-415c-a5da-12c6e336dd4c service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb7bca3e-fd5f-457e-92b8-70c55f78b8c9 req-fbfed560-9c34-415c-a5da-12c6e336dd4c service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb7bca3e-fd5f-457e-92b8-70c55f78b8c9 req-fbfed560-9c34-415c-a5da-12c6e336dd4c service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] No waiting events found dispatching network-vif-unplugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:31:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb7bca3e-fd5f-457e-92b8-70c55f78b8c9 req-fbfed560-9c34-415c-a5da-12c6e336dd4c service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received event network-vif-unplugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:32:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Instance destroyed successfully.
Nov 15 11:32:00 user nova-compute[76049]: DEBUG nova.objects.instance [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lazy-loading 'resources' on Instance uuid d0f0287a-5e2c-4a02-8490-da45ae1e86b9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1356958465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1356958465',id=13,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a9fe3c211d4bb78b9c6878147a9c75',ramdisk_id='',reservation_id='r-jreq370v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:14:19Z,user_data=None,user_id='81bd63b00a9c4f8983e335cf898f77ad',uuid=d0f0287a-5e2c-4a02-8490-da45ae1e86b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converting VIF {"id": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "address": "fa:16:3e:85:a3:79", "network": {"id": "cbb053fe-f007-4ebf-9cc6-10a6db56458c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1635509739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9fe3c211d4bb78b9c6878147a9c75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcf4f7a-9f", "ovs_interfaceid": "ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebcf4f7a-9f') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG os_vif [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebcf4f7a-9f') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebcf4f7a-9f, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1153f6f-917a-4405-bf3f-eec0ed5a391b) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:00 user nova-compute[76049]: INFO os_vif [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8,network=Network(cbb053fe-f007-4ebf-9cc6-10a6db56458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebcf4f7a-9f')
Nov 15 11:32:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Deleting instance files /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9_del
Nov 15 11:32:00 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Deletion of /opt/stack/data/nova/instances/d0f0287a-5e2c-4a02-8490-da45ae1e86b9_del complete
Nov 15 11:32:00 user nova-compute[76049]: INFO nova.compute.manager [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 11:32:00 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:32:00 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Took 0.43 seconds to deallocate network for instance.
Nov 15 11:32:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:01 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Deleted allocations for instance d0f0287a-5e2c-4a02-8490-da45ae1e86b9
Nov 15 11:32:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-d0b051b6-ca1a-44c7-8bb2-8a55e2280d60 tempest-ServerBootFromVolumeStableRescueTest-1027868851 tempest-ServerBootFromVolumeStableRescueTest-1027868851-project-member] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.634s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-70b266e4-3351-496c-af60-434283921d31 req-7e40c318-d3f7-4d06-b2f5-6afd99f12de5 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received event network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-70b266e4-3351-496c-af60-434283921d31 req-7e40c318-d3f7-4d06-b2f5-6afd99f12de5 service nova] Acquiring lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-70b266e4-3351-496c-af60-434283921d31 req-7e40c318-d3f7-4d06-b2f5-6afd99f12de5 service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-70b266e4-3351-496c-af60-434283921d31 req-7e40c318-d3f7-4d06-b2f5-6afd99f12de5 service nova] Lock "d0f0287a-5e2c-4a02-8490-da45ae1e86b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-70b266e4-3351-496c-af60-434283921d31 req-7e40c318-d3f7-4d06-b2f5-6afd99f12de5 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] No waiting events found dispatching network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:32:01 user nova-compute[76049]: WARNING nova.compute.manager [req-70b266e4-3351-496c-af60-434283921d31 req-7e40c318-d3f7-4d06-b2f5-6afd99f12de5 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received unexpected event network-vif-plugged-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 for instance with vm_state deleted and task_state None.
Nov 15 11:32:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-70b266e4-3351-496c-af60-434283921d31 req-7e40c318-d3f7-4d06-b2f5-6afd99f12de5 service nova] [instance: d0f0287a-5e2c-4a02-8490-da45ae1e86b9] Received event network-vif-deleted-ebcf4f7a-9f3a-4d28-92a3-f88db542c1a8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:32:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:32:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:32:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:32:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "25c772f6-5656-46b5-9461-d720314b29ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:27 user nova-compute[76049]: INFO nova.compute.manager [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Terminating instance
Nov 15 11:32:27 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-1e1e85a0-eda1-4c2c-90a1-30c8128294e9 req-45045260-042a-4dca-a922-cf3a6b2b7d60 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-vif-unplugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1e1e85a0-eda1-4c2c-90a1-30c8128294e9 req-45045260-042a-4dca-a922-cf3a6b2b7d60 service nova] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1e1e85a0-eda1-4c2c-90a1-30c8128294e9 req-45045260-042a-4dca-a922-cf3a6b2b7d60 service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-1e1e85a0-eda1-4c2c-90a1-30c8128294e9 req-45045260-042a-4dca-a922-cf3a6b2b7d60 service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-1e1e85a0-eda1-4c2c-90a1-30c8128294e9 req-45045260-042a-4dca-a922-cf3a6b2b7d60 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] No waiting events found dispatching network-vif-unplugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.compute.manager [req-1e1e85a0-eda1-4c2c-90a1-30c8128294e9 req-45045260-042a-4dca-a922-cf3a6b2b7d60 service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-vif-unplugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:32:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Instance destroyed successfully.
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lazy-loading 'resources' on Instance uuid 25c772f6-5656-46b5-9461-d720314b29ae {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24798472',display_name='tempest-ServerActionsTestOtherA-server-24798472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24798472',id=17,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABmeokLWqflI76dCgHoXIJJ5ySVU6i+ykL/B4nLWBLLXSaiuWR4J+H+OjzXdftSPqsJ5YafA0t7F3YIhxN88F5LBVA/NARkisZ/4DnGrcq+BpHpG0/B2+XWY558P1T/Sg==',key_name='tempest-keypair-889684922',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a61718ae918a495eadf79664d2ea66c6',ramdisk_id='',reservation_id='r-bnkvvjn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278593450',owner_user_name='tempest-ServerActionsTestOtherA-278593450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c548eac583644342a905b89ee8fc4b1a',uuid=25c772f6-5656-46b5-9461-d720314b29ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converting VIF {"id": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "address": "fa:16:3e:97:cf:d6", "network": {"id": "5e7dcb36-cdb8-4a83-b989-d434c2c451c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1811445490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a61718ae918a495eadf79664d2ea66c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35c63a9-bd", "ovs_interfaceid": "b35c63a9-bd65-4a46-a9bd-87decd1daeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=b35c63a9-bd65-4a46-a9bd-87decd1daeb8,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35c63a9-bd') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG os_vif [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=b35c63a9-bd65-4a46-a9bd-87decd1daeb8,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35c63a9-bd') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb35c63a9-bd, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5661c098-ce82-456c-a6b9-188c0d1bbcc4) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:28 user nova-compute[76049]: INFO os_vif [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=b35c63a9-bd65-4a46-a9bd-87decd1daeb8,network=Network(5e7dcb36-cdb8-4a83-b989-d434c2c451c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35c63a9-bd')
Nov 15 11:32:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Deleting instance files /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae_del
Nov 15 11:32:28 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Deletion of /opt/stack/data/nova/instances/25c772f6-5656-46b5-9461-d720314b29ae_del complete
Nov 15 11:32:28 user nova-compute[76049]: INFO nova.compute.manager [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 11:32:28 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:32:28 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:32:29 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:32:29 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Took 0.55 seconds to deallocate network for instance.
Nov 15 11:32:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:29 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:32:29 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:32:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:29 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Deleted allocations for instance 25c772f6-5656-46b5-9461-d720314b29ae
Nov 15 11:32:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1a6bce3a-877c-4f40-b0ac-42b4db4f93cb tempest-ServerActionsTestOtherA-278593450 tempest-ServerActionsTestOtherA-278593450-project-member] Lock "25c772f6-5656-46b5-9461-d720314b29ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.851s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-796bac3b-c8a1-465d-bda7-91a7668ad023 req-8e1d63ee-a031-4451-98b5-1cdcb7018aff service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-796bac3b-c8a1-465d-bda7-91a7668ad023 req-8e1d63ee-a031-4451-98b5-1cdcb7018aff service nova] Acquiring lock "25c772f6-5656-46b5-9461-d720314b29ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-796bac3b-c8a1-465d-bda7-91a7668ad023 req-8e1d63ee-a031-4451-98b5-1cdcb7018aff service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-796bac3b-c8a1-465d-bda7-91a7668ad023 req-8e1d63ee-a031-4451-98b5-1cdcb7018aff service nova] Lock "25c772f6-5656-46b5-9461-d720314b29ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-796bac3b-c8a1-465d-bda7-91a7668ad023 req-8e1d63ee-a031-4451-98b5-1cdcb7018aff service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] No waiting events found dispatching network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:32:30 user nova-compute[76049]: WARNING nova.compute.manager [req-796bac3b-c8a1-465d-bda7-91a7668ad023 req-8e1d63ee-a031-4451-98b5-1cdcb7018aff service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received unexpected event network-vif-plugged-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 for instance with vm_state deleted and task_state None.
Nov 15 11:32:30 user nova-compute[76049]: DEBUG nova.compute.manager [req-796bac3b-c8a1-465d-bda7-91a7668ad023 req-8e1d63ee-a031-4451-98b5-1cdcb7018aff service nova] [instance: 25c772f6-5656-46b5-9461-d720314b29ae] Received event network-vif-deleted-b35c63a9-bd65-4a46-a9bd-87decd1daeb8 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:33 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:32:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:32:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:32:33 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:32:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:34 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:32:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:32:34 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:32:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:37 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:32:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:32:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:32:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:32:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:32:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:32:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:32:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.21292495727539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:32:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:47 user nova-compute[76049]: INFO nova.compute.manager [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Unrescuing
Nov 15 11:32:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'flavor' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-e29574c7-b7df-4634-9aa5-83db2a8746a3 req-9515e495-9c09-42fb-a9d3-c612f82fd895 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e29574c7-b7df-4634-9aa5-83db2a8746a3 req-9515e495-9c09-42fb-a9d3-c612f82fd895 service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e29574c7-b7df-4634-9aa5-83db2a8746a3 req-9515e495-9c09-42fb-a9d3-c612f82fd895 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e29574c7-b7df-4634-9aa5-83db2a8746a3 req-9515e495-9c09-42fb-a9d3-c612f82fd895 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG nova.compute.manager [req-e29574c7-b7df-4634-9aa5-83db2a8746a3 req-9515e495-9c09-42fb-a9d3-c612f82fd895 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:32:47 user nova-compute[76049]: WARNING nova.compute.manager [req-e29574c7-b7df-4634-9aa5-83db2a8746a3 req-9515e495-9c09-42fb-a9d3-c612f82fd895 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:32:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance destroyed successfully.
Nov 15 11:32:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:32:49 user nova-compute[76049]: WARNING nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:32:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:32:49 user nova-compute[76049]: WARNING nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:32:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:32:49 user nova-compute[76049]: DEBUG nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:32:49 user nova-compute[76049]: WARNING nova.compute.manager [req-128eda51-48a6-4ab0-9bbe-0c899bce3913 req-fa942f22-0d97-4fb9-80bb-36fe51c0e7fb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:32:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-b9a359dc-5f83-4398-bfb0-72fe3ffcad4d tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:32:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:32:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:32:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:32:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:32:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:32:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:32:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:33:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:33:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:33:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:33:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:33:35 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:33:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:35 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:33:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:33:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:33:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:33:45 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:33:45 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8850MB free_disk=25.200347900390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:33:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:33:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:33:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:33:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:33:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:34:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:34:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:34:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:34:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:34:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:34:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:34:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:34:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:34:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:34:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:33 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:34 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:37 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:34:37 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:34:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:34:37 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:34:37 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:34:37 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:34:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:34:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:34:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:34:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:34:42 user nova-compute[76049]: INFO nova.compute.claims [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Claim successful on node user
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:34:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.policy [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a364f470c402bbd91712302c611cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde1d2d3e99a4c96ab95220df3de4ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:34:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Creating image(s)
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk 1073741824" returned: 0 in 0.050s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Successfully created port: 47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Cannot resize image /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Ensure instance console log exists: /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Successfully updated port: 47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing instance network info cache due to event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:34:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.neutron [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance network_info: |[{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.neutron [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Start _get_guest_xml network_info=[{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:34:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:34:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609143757',display_name='tempest-ServerRescueNegativeTestJSON-server-1609143757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609143757',id=48,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiLxtZJX4+1l4YtqIojBRcP6lX92Rs9wy/gHx5XdZ++Tz7PqYPJPtppBxpaxBl0DmJsl4s/UZKLMZMdbYSGjvnh5xg4LF8TcXcCiUfPaCv7CIXCPqUDna/XMeX2KH7ISw==',key_name='tempest-keypair-1623530985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-cva1ztz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab6a364f470c402bbd91712302c611cd',uuid=fb2e912c-7a21-43e0-8904-bf4862a1e876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.objects.instance [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'pci_devices' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:34:44 user nova-compute[76049]:   <uuid>fb2e912c-7a21-43e0-8904-bf4862a1e876</uuid>
Nov 15 11:34:44 user nova-compute[76049]:   <name>instance-00000030</name>
Nov 15 11:34:44 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:34:44 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:34:44 user nova-compute[76049]:   <metadata>
Nov 15 11:34:44 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:34:44 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:34:44 user nova-compute[76049]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1609143757</nova:name>
Nov 15 11:34:44 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:34:44</nova:creationTime>
Nov 15 11:34:44 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:34:44 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:34:44 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:34:44 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:34:44 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:34:44 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:34:44 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:34:44 user nova-compute[76049]:       <nova:owner>
Nov 15 11:34:44 user nova-compute[76049]:         <nova:user uuid="ab6a364f470c402bbd91712302c611cd">tempest-ServerRescueNegativeTestJSON-47045426-project-member</nova:user>
Nov 15 11:34:44 user nova-compute[76049]:         <nova:project uuid="fde1d2d3e99a4c96ab95220df3de4ad4">tempest-ServerRescueNegativeTestJSON-47045426</nova:project>
Nov 15 11:34:44 user nova-compute[76049]:       </nova:owner>
Nov 15 11:34:44 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:34:44 user nova-compute[76049]:       <nova:ports>
Nov 15 11:34:44 user nova-compute[76049]:         <nova:port uuid="47c79433-b2d2-4d8c-a111-12ddaeebde14">
Nov 15 11:34:44 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 11:34:44 user nova-compute[76049]:         </nova:port>
Nov 15 11:34:44 user nova-compute[76049]:       </nova:ports>
Nov 15 11:34:44 user nova-compute[76049]:     </nova:instance>
Nov 15 11:34:44 user nova-compute[76049]:   </metadata>
Nov 15 11:34:44 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:34:44 user nova-compute[76049]:     <system>
Nov 15 11:34:44 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:34:44 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:34:44 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:34:44 user nova-compute[76049]:       <entry name="serial">fb2e912c-7a21-43e0-8904-bf4862a1e876</entry>
Nov 15 11:34:44 user nova-compute[76049]:       <entry name="uuid">fb2e912c-7a21-43e0-8904-bf4862a1e876</entry>
Nov 15 11:34:44 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:34:44 user nova-compute[76049]:     </system>
Nov 15 11:34:44 user nova-compute[76049]:   </sysinfo>
Nov 15 11:34:44 user nova-compute[76049]:   <os>
Nov 15 11:34:44 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:34:44 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:34:44 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:34:44 user nova-compute[76049]:   </os>
Nov 15 11:34:44 user nova-compute[76049]:   <features>
Nov 15 11:34:44 user nova-compute[76049]:     <acpi/>
Nov 15 11:34:44 user nova-compute[76049]:     <apic/>
Nov 15 11:34:44 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:34:44 user nova-compute[76049]:   </features>
Nov 15 11:34:44 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:34:44 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:34:44 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:34:44 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:34:44 user nova-compute[76049]:   </clock>
Nov 15 11:34:44 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:34:44 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:34:44 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:34:44 user nova-compute[76049]:   </cpu>
Nov 15 11:34:44 user nova-compute[76049]:   <devices>
Nov 15 11:34:44 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:34:44 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:34:44 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk"/>
Nov 15 11:34:44 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:34:44 user nova-compute[76049]:     </disk>
Nov 15 11:34:44 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:34:44 user nova-compute[76049]:       <mac address="fa:16:3e:b9:61:c5"/>
Nov 15 11:34:44 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:34:44 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:34:44 user nova-compute[76049]:       <target dev="tap47c79433-b2"/>
Nov 15 11:34:44 user nova-compute[76049]:     </interface>
Nov 15 11:34:44 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:34:44 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/console.log" append="off"/>
Nov 15 11:34:44 user nova-compute[76049]:     </serial>
Nov 15 11:34:44 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:34:44 user nova-compute[76049]:     <video>
Nov 15 11:34:44 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:34:44 user nova-compute[76049]:     </video>
Nov 15 11:34:44 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:34:44 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:34:44 user nova-compute[76049]:     </rng>
Nov 15 11:34:44 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:34:44 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:34:44 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:34:44 user nova-compute[76049]:     </memballoon>
Nov 15 11:34:44 user nova-compute[76049]:   </devices>
Nov 15 11:34:44 user nova-compute[76049]: </domain>
Nov 15 11:34:44 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609143757',display_name='tempest-ServerRescueNegativeTestJSON-server-1609143757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609143757',id=48,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiLxtZJX4+1l4YtqIojBRcP6lX92Rs9wy/gHx5XdZ++Tz7PqYPJPtppBxpaxBl0DmJsl4s/UZKLMZMdbYSGjvnh5xg4LF8TcXcCiUfPaCv7CIXCPqUDna/XMeX2KH7ISw==',key_name='tempest-keypair-1623530985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-cva1ztz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab6a364f470c402bbd91712302c611cd',uuid=fb2e912c-7a21-43e0-8904-bf4862a1e876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG os_vif [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5cf530f-4038-5c36-b07d-2b09380d6c80', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47c79433-b2, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47c79433-b2, col_values=(('qos', UUID('eeb6b394-9197-495d-b12a-cc78a1f97248')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47c79433-b2, col_values=(('external_ids', {'iface-id': '47c79433-b2d2-4d8c-a111-12ddaeebde14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:61:c5', 'vm-uuid': 'fb2e912c-7a21-43e0-8904-bf4862a1e876'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:44 user nova-compute[76049]: INFO os_vif [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2')
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No VIF found with MAC fa:16:3e:b9:61:c5, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.neutron [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updated VIF entry in instance network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG nova.network.neutron [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:34:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d10d2a57-45e1-45f6-a6aa-6bd64ce73a25 req-88705180-37d0-4b90-8a60-f8832e50e899 service nova] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG nova.compute.manager [req-0d90f995-d2f3-48b4-8a68-28a3ec62e716 req-9d72e8b1-c9af-4f3d-9f69-36452ff74264 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d90f995-d2f3-48b4-8a68-28a3ec62e716 req-9d72e8b1-c9af-4f3d-9f69-36452ff74264 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d90f995-d2f3-48b4-8a68-28a3ec62e716 req-9d72e8b1-c9af-4f3d-9f69-36452ff74264 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0d90f995-d2f3-48b4-8a68-28a3ec62e716 req-9d72e8b1-c9af-4f3d-9f69-36452ff74264 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:45 user nova-compute[76049]: DEBUG nova.compute.manager [req-0d90f995-d2f3-48b4-8a68-28a3ec62e716 req-9d72e8b1-c9af-4f3d-9f69-36452ff74264 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:34:45 user nova-compute[76049]: WARNING nova.compute.manager [req-0d90f995-d2f3-48b4-8a68-28a3ec62e716 req-9d72e8b1-c9af-4f3d-9f69-36452ff74264 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state building and task_state spawning.
Nov 15 11:34:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:34:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-bce19814-5f05-4ff0-a285-820215d7ebac req-f4b41128-af86-4681-909a-94ceb1d61804 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bce19814-5f05-4ff0-a285-820215d7ebac req-f4b41128-af86-4681-909a-94ceb1d61804 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bce19814-5f05-4ff0-a285-820215d7ebac req-f4b41128-af86-4681-909a-94ceb1d61804 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bce19814-5f05-4ff0-a285-820215d7ebac req-f4b41128-af86-4681-909a-94ceb1d61804 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.manager [req-bce19814-5f05-4ff0-a285-820215d7ebac req-f4b41128-af86-4681-909a-94ceb1d61804 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:34:48 user nova-compute[76049]: WARNING nova.compute.manager [req-bce19814-5f05-4ff0-a285-820215d7ebac req-f4b41128-af86-4681-909a-94ceb1d61804 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state building and task_state spawning.
Nov 15 11:34:48 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:34:48 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.19641876220703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:34:48 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance spawned successfully.
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fb2e912c-7a21-43e0-8904-bf4862a1e876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:34:48 user nova-compute[76049]: INFO nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:34:48 user nova-compute[76049]: INFO nova.compute.manager [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Took 5.91 seconds to build instance.
Nov 15 11:34:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-a520b915-b305-4621-addd-38c1bb1ec6a9 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.007s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:34:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:34:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:34:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:35:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:35:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:35:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:35:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:35:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:35:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:35:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:35:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.283s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:49 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:35:49 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=25.16751480102539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fb2e912c-7a21-43e0-8904-bf4862a1e876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:35:49 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:35:50 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:35:50 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:35:50 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:35:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:35:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:35:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:35:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:36:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:36:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:36:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:36:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:36:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:36:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG nova.compute.manager [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing instance network info cache due to event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'flavor' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:33 user nova-compute[76049]: INFO nova.compute.manager [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Attaching volume 304d7fcc-b4d0-4c9a-a9ac-b14286a56660 to /dev/vdb
Nov 15 11:36:33 user nova-compute[76049]: DEBUG os_brick.utils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f461c9-39fa-4608-9dac-4f850bbc9b19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updated VIF entry in instance network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG nova.network.neutron [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f92c1c-ee02-4d3f-8446-1abe1f3d67b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a1b4ba1a-8607-4817-a0fa-b14f13f9062d req-3a554046-3ba7-480f-a3da-08530583a8bc service nova] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[72de01d1-56ab-49f6-88e5-37df5430e23d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[669d3162-0ecb-4c6c-918e-d229f8d00c2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:36:33 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:36:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a66bb3-00b5-4baf-b02f-253deb4486c8]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG os_brick.utils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:36:33 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating existing volume attachment record: 58b21514-4ee1-4f7a-8134-c0a4e4778da2 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:36:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkPlYdGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:36:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:36:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:36:38 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e948723-541f-48bb-8cfd-bbb9306c6b0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:36:38 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce557552-1d98-4790-9ad3-ff0fea72fd0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660] added
Nov 15 11:36:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808e181-2500-48e2-a8d9-04c39d5d6382]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[43219604-be95-461c-b8c1-7e9d898015f7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkPlYdGH {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkPlYdGH" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d47d0-d913-4540-a458-925f535361fb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkPlYdGH'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb58216a-ed44-4c0d-9d35-1dcec9a0ff4f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9fe3b7-9f65-48ca-a86b-1392c6ecf306]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:36:38 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:36:38 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:36:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 11:36:38 user nova-compute[76049]: 
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe45cf-fdc8-4fbc-8abe-0b28643de815]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260]
Nov 15 11:36:38 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260] successful.
Nov 15 11:36:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5495c8-0953-4742-8255-6dfe087c9520]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b509003-e0e7-4280-9aa1-7756e9b90306]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 (non-flash)
Nov 15 11:36:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 (non-flash)
Nov 15 11:36:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f9bbc-b1de-43b5-b9d6-a88672b3272c]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkPlYdGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_power_states {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26630613138356662', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630613138356662', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.objects.instance [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'flavor' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:36:39 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:36:39 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:36:39 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:36:39 user nova-compute[76049]:   <serial>304d7fcc-b4d0-4c9a-a9ac-b14286a56660</serial>
Nov 15 11:36:39 user nova-compute[76049]: </disk>
Nov 15 11:36:39 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No VIF found with MAC fa:16:3e:b9:61:c5, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-6501eaa7-3b25-44eb-ae3e-d95f008de6ed tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.531s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.119s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:41 user nova-compute[76049]: INFO nova.compute.manager [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Rescuing
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-23527d8c-5b9f-4ffe-a82c-a9c52e24fac3 req-10837463-db9a-424a-a777-32d33a1da263 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23527d8c-5b9f-4ffe-a82c-a9c52e24fac3 req-10837463-db9a-424a-a777-32d33a1da263 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23527d8c-5b9f-4ffe-a82c-a9c52e24fac3 req-10837463-db9a-424a-a777-32d33a1da263 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-23527d8c-5b9f-4ffe-a82c-a9c52e24fac3 req-10837463-db9a-424a-a777-32d33a1da263 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:41 user nova-compute[76049]: DEBUG nova.compute.manager [req-23527d8c-5b9f-4ffe-a82c-a9c52e24fac3 req-10837463-db9a-424a-a777-32d33a1da263 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:36:41 user nova-compute[76049]: WARNING nova.compute.manager [req-23527d8c-5b9f-4ffe-a82c-a9c52e24fac3 req-10837463-db9a-424a-a777-32d33a1da263 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state active and task_state rescuing.
Nov 15 11:36:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance destroyed successfully.
Nov 15 11:36:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Attempting rescue
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76049) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance directory exists: not creating {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 11:36:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Creating image(s)
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue" returned: 0 in 0.050s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'migration_context' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.base [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<fb2e912c-7a21-43e0-8904-bf4862a1e876> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Start _get_guest_xml network_info=[{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:b9:61:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'resources' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.base [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<fb2e912c-7a21-43e0-8904-bf4862a1e876> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'numa_topology' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.base [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<fb2e912c-7a21-43e0-8904-bf4862a1e876> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:36:42 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:36:42 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.base [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<fb2e912c-7a21-43e0-8904-bf4862a1e876> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609143757',display_name='tempest-ServerRescueNegativeTestJSON-server-1609143757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609143757',id=48,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiLxtZJX4+1l4YtqIojBRcP6lX92Rs9wy/gHx5XdZ++Tz7PqYPJPtppBxpaxBl0DmJsl4s/UZKLMZMdbYSGjvnh5xg4LF8TcXcCiUfPaCv7CIXCPqUDna/XMeX2KH7ISw==',key_name='tempest-keypair-1623530985',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-cva1ztz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:34:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab6a364f470c402bbd91712302c611cd',uuid=fb2e912c-7a21-43e0-8904-bf4862a1e876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:b9:61:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "vif_mac": "fa:16:3e:b9:61:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'pci_devices' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.objects.base [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Object Instance<fb2e912c-7a21-43e0-8904-bf4862a1e876> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76049) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:36:42 user nova-compute[76049]:   <uuid>fb2e912c-7a21-43e0-8904-bf4862a1e876</uuid>
Nov 15 11:36:42 user nova-compute[76049]:   <name>instance-00000030</name>
Nov 15 11:36:42 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:36:42 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:36:42 user nova-compute[76049]:   <metadata>
Nov 15 11:36:42 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:36:42 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:36:42 user nova-compute[76049]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1609143757</nova:name>
Nov 15 11:36:42 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:36:42</nova:creationTime>
Nov 15 11:36:42 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:36:42 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:36:42 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:36:42 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:36:42 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:36:42 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:36:42 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:36:42 user nova-compute[76049]:       <nova:owner>
Nov 15 11:36:42 user nova-compute[76049]:         <nova:user uuid="ab6a364f470c402bbd91712302c611cd">tempest-ServerRescueNegativeTestJSON-47045426-project-member</nova:user>
Nov 15 11:36:42 user nova-compute[76049]:         <nova:project uuid="fde1d2d3e99a4c96ab95220df3de4ad4">tempest-ServerRescueNegativeTestJSON-47045426</nova:project>
Nov 15 11:36:42 user nova-compute[76049]:       </nova:owner>
Nov 15 11:36:42 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:36:42 user nova-compute[76049]:       <nova:ports>
Nov 15 11:36:42 user nova-compute[76049]:         <nova:port uuid="47c79433-b2d2-4d8c-a111-12ddaeebde14">
Nov 15 11:36:42 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 11:36:42 user nova-compute[76049]:         </nova:port>
Nov 15 11:36:42 user nova-compute[76049]:       </nova:ports>
Nov 15 11:36:42 user nova-compute[76049]:     </nova:instance>
Nov 15 11:36:42 user nova-compute[76049]:   </metadata>
Nov 15 11:36:42 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:36:42 user nova-compute[76049]:     <system>
Nov 15 11:36:42 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:36:42 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:36:42 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:36:42 user nova-compute[76049]:       <entry name="serial">fb2e912c-7a21-43e0-8904-bf4862a1e876</entry>
Nov 15 11:36:42 user nova-compute[76049]:       <entry name="uuid">fb2e912c-7a21-43e0-8904-bf4862a1e876</entry>
Nov 15 11:36:42 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:36:42 user nova-compute[76049]:     </system>
Nov 15 11:36:42 user nova-compute[76049]:   </sysinfo>
Nov 15 11:36:42 user nova-compute[76049]:   <os>
Nov 15 11:36:42 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:36:42 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:36:42 user nova-compute[76049]:   </os>
Nov 15 11:36:42 user nova-compute[76049]:   <features>
Nov 15 11:36:42 user nova-compute[76049]:     <acpi/>
Nov 15 11:36:42 user nova-compute[76049]:     <apic/>
Nov 15 11:36:42 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:36:42 user nova-compute[76049]:   </features>
Nov 15 11:36:42 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:36:42 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:36:42 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:36:42 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:36:42 user nova-compute[76049]:   </clock>
Nov 15 11:36:42 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:36:42 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:36:42 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:36:42 user nova-compute[76049]:   </cpu>
Nov 15 11:36:42 user nova-compute[76049]:   <devices>
Nov 15 11:36:42 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:36:42 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:36:42 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue"/>
Nov 15 11:36:42 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:36:42 user nova-compute[76049]:     </disk>
Nov 15 11:36:42 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:36:42 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:36:42 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk"/>
Nov 15 11:36:42 user nova-compute[76049]:       <target dev="vdb" bus="virtio"/>
Nov 15 11:36:42 user nova-compute[76049]:     </disk>
Nov 15 11:36:42 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:36:42 user nova-compute[76049]:       <mac address="fa:16:3e:b9:61:c5"/>
Nov 15 11:36:42 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:36:42 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:36:42 user nova-compute[76049]:       <target dev="tap47c79433-b2"/>
Nov 15 11:36:42 user nova-compute[76049]:     </interface>
Nov 15 11:36:42 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:36:42 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/console.log" append="off"/>
Nov 15 11:36:42 user nova-compute[76049]:     </serial>
Nov 15 11:36:42 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:36:42 user nova-compute[76049]:     <video>
Nov 15 11:36:42 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:36:42 user nova-compute[76049]:     </video>
Nov 15 11:36:42 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:36:42 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:36:42 user nova-compute[76049]:     </rng>
Nov 15 11:36:42 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:36:42 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:36:42 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:36:42 user nova-compute[76049]:     </memballoon>
Nov 15 11:36:42 user nova-compute[76049]:   </devices>
Nov 15 11:36:42 user nova-compute[76049]: </domain>
Nov 15 11:36:42 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:36:42 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance destroyed successfully.
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:36:42 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] No VIF found with MAC fa:16:3e:b9:61:c5, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:36:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-d2bacf8b-539d-45e4-a291-e3517fa9b37b req-689bfdef-23df-4e33-966a-c85370d3201d service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:36:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d2bacf8b-539d-45e4-a291-e3517fa9b37b req-689bfdef-23df-4e33-966a-c85370d3201d service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d2bacf8b-539d-45e4-a291-e3517fa9b37b req-689bfdef-23df-4e33-966a-c85370d3201d service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d2bacf8b-539d-45e4-a291-e3517fa9b37b req-689bfdef-23df-4e33-966a-c85370d3201d service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:43 user nova-compute[76049]: DEBUG nova.compute.manager [req-d2bacf8b-539d-45e4-a291-e3517fa9b37b req-689bfdef-23df-4e33-966a-c85370d3201d service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:36:43 user nova-compute[76049]: WARNING nova.compute.manager [req-d2bacf8b-539d-45e4-a291-e3517fa9b37b req-689bfdef-23df-4e33-966a-c85370d3201d service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state active and task_state rescuing.
Nov 15 11:36:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:36:46 user nova-compute[76049]: WARNING nova.compute.manager [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state active and task_state rescuing.
Nov 15 11:36:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:36:46 user nova-compute[76049]: WARNING nova.compute.manager [req-089d46ef-a243-45b1-8cbb-a59ad1f770e2 req-13f49a50-199e-456e-9223-0f5cab1eb973 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state active and task_state rescuing.
Nov 15 11:36:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2be85d2-c367-4556-aba9-3c56cfd4838c tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:36:46 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:49 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:36:51 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:36:51 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=25.165782928466797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fb2e912c-7a21-43e0-8904-bf4862a1e876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:36:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:36:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:36:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:37:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:37:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:37:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:37:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:37:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:37:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:46 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:47 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:51 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:37:53 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:37:53 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.164958953857422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fb2e912c-7a21-43e0-8904-bf4862a1e876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:37:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:37:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:37:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:32 user nova-compute[76049]: INFO nova.compute.manager [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Unrescuing
Nov 15 11:38:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG nova.network.neutron [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG nova.objects.instance [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'flavor' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-929ab063-57d8-47ca-8614-4f5a969b4f4b req-6a059d05-1771-4ec4-b71c-aeae7b22ce8c service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-929ab063-57d8-47ca-8614-4f5a969b4f4b req-6a059d05-1771-4ec4-b71c-aeae7b22ce8c service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-929ab063-57d8-47ca-8614-4f5a969b4f4b req-6a059d05-1771-4ec4-b71c-aeae7b22ce8c service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-929ab063-57d8-47ca-8614-4f5a969b4f4b req-6a059d05-1771-4ec4-b71c-aeae7b22ce8c service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG nova.compute.manager [req-929ab063-57d8-47ca-8614-4f5a969b4f4b req-6a059d05-1771-4ec4-b71c-aeae7b22ce8c service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:38:32 user nova-compute[76049]: WARNING nova.compute.manager [req-929ab063-57d8-47ca-8614-4f5a969b4f4b req-6a059d05-1771-4ec4-b71c-aeae7b22ce8c service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:38:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:33 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance destroyed successfully.
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:38:34 user nova-compute[76049]: WARNING nova.compute.manager [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:38:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:38:34 user nova-compute[76049]: DEBUG nova.compute.manager [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:38:34 user nova-compute[76049]: WARNING nova.compute.manager [req-dacabe97-f258-424f-bda3-ef2d46be8fc7 req-7bbb0f57-a572-4a4d-b83f-fda62045a598 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state rescued and task_state unrescuing.
Nov 15 11:38:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-231c6e1e-b573-454c-9c86-c387b30f78e5 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:38:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-c3ed6827-7464-4adc-8646-5012f00b0d83 req-80ef5512-986d-409b-a7b4-7ef1826d4414 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:38:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c3ed6827-7464-4adc-8646-5012f00b0d83 req-80ef5512-986d-409b-a7b4-7ef1826d4414 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:38:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c3ed6827-7464-4adc-8646-5012f00b0d83 req-80ef5512-986d-409b-a7b4-7ef1826d4414 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:38:36 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c3ed6827-7464-4adc-8646-5012f00b0d83 req-80ef5512-986d-409b-a7b4-7ef1826d4414 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:38:36 user nova-compute[76049]: DEBUG nova.compute.manager [req-c3ed6827-7464-4adc-8646-5012f00b0d83 req-80ef5512-986d-409b-a7b4-7ef1826d4414 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:38:36 user nova-compute[76049]: WARNING nova.compute.manager [req-c3ed6827-7464-4adc-8646-5012f00b0d83 req-80ef5512-986d-409b-a7b4-7ef1826d4414 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state active and task_state None.
Nov 15 11:38:37 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:38:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:42 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:38:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:47 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:52 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:53 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:38:54 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:38:54 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.15615463256836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fb2e912c-7a21-43e0-8904-bf4862a1e876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:38:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:38:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:38:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:39:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:41 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:39:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:39:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:39:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:39:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:39:43 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:39:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:39:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76049) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 11:39:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:39:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.155406951904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fb2e912c-7a21-43e0-8904-bf4862a1e876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:39:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:39:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:40:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:40:23 user nova-compute[76049]: DEBUG nova.compute.manager [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing instance network info cache due to event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:40:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:40:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:40:23 user nova-compute[76049]: DEBUG nova.network.neutron [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updated VIF entry in instance network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG nova.network.neutron [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-073a3a64-aacf-48df-891b-654f0d78d4dc req-2005011a-7de3-46ad-a777-224560fc8098 service nova] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:40:24 user nova-compute[76049]: INFO nova.compute.manager [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Detaching volume 304d7fcc-b4d0-4c9a-a9ac-b14286a56660
Nov 15 11:40:24 user nova-compute[76049]: INFO nova.virt.block_device [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Attempting to driver detach volume 304d7fcc-b4d0-4c9a-a9ac-b14286a56660 from mountpoint /dev/vdb
Nov 15 11:40:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Attempting to detach device vdb from instance fb2e912c-7a21-43e0-8904-bf4862a1e876 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:40:24 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:40:24 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:40:24 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:40:24 user nova-compute[76049]:   <serial>304d7fcc-b4d0-4c9a-a9ac-b14286a56660</serial>
Nov 15 11:40:24 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:40:24 user nova-compute[76049]: </disk>
Nov 15 11:40:24 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:40:24 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully detached device vdb from instance fb2e912c-7a21-43e0-8904-bf4862a1e876 from the persistent domain config.
Nov 15 11:40:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb2e912c-7a21-43e0-8904-bf4862a1e876 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:40:24 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:40:24 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:40:24 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:40:24 user nova-compute[76049]:   <serial>304d7fcc-b4d0-4c9a-a9ac-b14286a56660</serial>
Nov 15 11:40:24 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:40:24 user nova-compute[76049]: </disk>
Nov 15 11:40:24 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:24 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:40:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:40:25 user nova-compute[76049]: DEBUG nova.compute.manager [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing instance network info cache due to event network-changed-47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:40:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] Acquiring lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:40:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] Acquired lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:40:25 user nova-compute[76049]: DEBUG nova.network.neutron [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Refreshing network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:40:26 user nova-compute[76049]: DEBUG nova.network.neutron [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updated VIF entry in instance network info cache for port 47c79433-b2d2-4d8c-a111-12ddaeebde14. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:40:26 user nova-compute[76049]: DEBUG nova.network.neutron [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [{"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:40:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3a752f4a-da64-4bfc-bba8-e27faa408413 req-5bc26821-0514-4b20-87f6-eb579086eb45 service nova] Releasing lock "refresh_cache-fb2e912c-7a21-43e0-8904-bf4862a1e876" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:40:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:40:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:40:42 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [{"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-8b274e91-15bd-49c1-8fee-12908102ee15" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:40:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:44 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb2e912c-7a21-43e0-8904-bf4862a1e876 is timed out.
Nov 15 11:40:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully detached device vdb from instance fb2e912c-7a21-43e0-8904-bf4862a1e876 from the live domain config.
Nov 15 11:40:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkPlYdGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:40:44 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f997fab-6b16-4760-947a-22e681fa3e39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:40:44 user nova-compute[76049]: No targets found.
Nov 15 11:40:44 user nova-compute[76049]: iSNS:
Nov 15 11:40:44 user nova-compute[76049]: No targets found.
Nov 15 11:40:44 user nova-compute[76049]: STATIC:
Nov 15 11:40:44 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660
Nov 15 11:40:44 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:40:44 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:40:44 user nova-compute[76049]: FIRMWARE:
Nov 15 11:40:44 user nova-compute[76049]: No targets found.
Nov 15 11:40:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:40:44 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:40:44 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e816f0-42a7-4361-a5c5-337631bdf5e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6355476f-d935-4b12-9a67-b54c683ed661]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 (non-flash)
Nov 15 11:40:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 (non-flash)
Nov 15 11:40:44 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607aca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[50350d8e-10a1-4b82-a0b3-5fe63e48387a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5977f4f-e940-4cbb-a253-47ba62f861cd]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e598c47-df63-413a-8a74-21d57d2eeb87]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b3545-ef17-43a1-a0b5-5900e7f8e36a]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac3969-75bd-4fb7-acbc-8f64123f1d68]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:40:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d08ce-3ec7-4920-9289-db400207d303]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260]
Nov 15 11:40:45 user nova-compute[76049]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660, portal: 172.16.0.220,3260] successful.
Nov 15 11:40:45 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304d7fcc-b4d0-4c9a-a9ac-b14286a56660 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f51d2-6f87-4645-92bf-299618f967f2]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] <== disconnect_volume: return (282ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'flavor' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:40:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0a664319-520c-479a-b790-0cc624f28905 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.626s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:40:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:40:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:40:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:40:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=25.154708862304688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance fb2e912c-7a21-43e0-8904-bf4862a1e876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:40:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:40:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:41:14 user nova-compute[76049]: INFO nova.compute.manager [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Terminating instance
Nov 15 11:41:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-302f13b7-9b1d-4922-b224-ebc9405194c8 req-8034f2ae-c28c-4fbf-9b6f-c8244332de91 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-302f13b7-9b1d-4922-b224-ebc9405194c8 req-8034f2ae-c28c-4fbf-9b6f-c8244332de91 service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-302f13b7-9b1d-4922-b224-ebc9405194c8 req-8034f2ae-c28c-4fbf-9b6f-c8244332de91 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-302f13b7-9b1d-4922-b224-ebc9405194c8 req-8034f2ae-c28c-4fbf-9b6f-c8244332de91 service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-302f13b7-9b1d-4922-b224-ebc9405194c8 req-8034f2ae-c28c-4fbf-9b6f-c8244332de91 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:41:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-302f13b7-9b1d-4922-b224-ebc9405194c8 req-8034f2ae-c28c-4fbf-9b6f-c8244332de91 service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-unplugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Instance destroyed successfully.
Nov 15 11:41:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'resources' on Instance uuid fb2e912c-7a21-43e0-8904-bf4862a1e876 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609143757',display_name='tempest-ServerRescueNegativeTestJSON-server-1609143757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609143757',id=48,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiLxtZJX4+1l4YtqIojBRcP6lX92Rs9wy/gHx5XdZ++Tz7PqYPJPtppBxpaxBl0DmJsl4s/UZKLMZMdbYSGjvnh5xg4LF8TcXcCiUfPaCv7CIXCPqUDna/XMeX2KH7ISw==',key_name='tempest-keypair-1623530985',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:36:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-cva1ztz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab6a364f470c402bbd91712302c611cd',uuid=fb2e912c-7a21-43e0-8904-bf4862a1e876,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "address": "fa:16:3e:b9:61:c5", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c79433-b2", "ovs_interfaceid": "47c79433-b2d2-4d8c-a111-12ddaeebde14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG os_vif [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47c79433-b2, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeb6b394-9197-495d-b12a-cc78a1f97248) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:15 user nova-compute[76049]: INFO os_vif [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:61:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c79433-b2d2-4d8c-a111-12ddaeebde14,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c79433-b2')
Nov 15 11:41:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Deleting instance files /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876_del
Nov 15 11:41:15 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Deletion of /opt/stack/data/nova/instances/fb2e912c-7a21-43e0-8904-bf4862a1e876_del complete
Nov 15 11:41:15 user nova-compute[76049]: INFO nova.compute.manager [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 11:41:15 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:41:15 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:41:16 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Took 0.85 seconds to deallocate network for instance.
Nov 15 11:41:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-db5bfd64-8cbd-46ce-95a1-919604fd884e req-27d161f2-8d33-4d9b-bd76-c68ef2eb237b service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-deleted-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:41:16 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Deleted allocations for instance fb2e912c-7a21-43e0-8904-bf4862a1e876
Nov 15 11:41:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c67f4c32-1c04-4371-a5ea-aee284f61b09 tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.033s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a4a1ab0-e8a2-401f-99e8-babde52bbaeb req-c951ee82-26f3-49f6-bdf6-9a143aa2b27f service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a4a1ab0-e8a2-401f-99e8-babde52bbaeb req-c951ee82-26f3-49f6-bdf6-9a143aa2b27f service nova] Acquiring lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a4a1ab0-e8a2-401f-99e8-babde52bbaeb req-c951ee82-26f3-49f6-bdf6-9a143aa2b27f service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a4a1ab0-e8a2-401f-99e8-babde52bbaeb req-c951ee82-26f3-49f6-bdf6-9a143aa2b27f service nova] Lock "fb2e912c-7a21-43e0-8904-bf4862a1e876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:41:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a4a1ab0-e8a2-401f-99e8-babde52bbaeb req-c951ee82-26f3-49f6-bdf6-9a143aa2b27f service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] No waiting events found dispatching network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:41:16 user nova-compute[76049]: WARNING nova.compute.manager [req-8a4a1ab0-e8a2-401f-99e8-babde52bbaeb req-c951ee82-26f3-49f6-bdf6-9a143aa2b27f service nova] [instance: fb2e912c-7a21-43e0-8904-bf4862a1e876] Received unexpected event network-vif-plugged-47c79433-b2d2-4d8c-a111-12ddaeebde14 for instance with vm_state deleted and task_state None.
Nov 15 11:41:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:41:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:41:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:41:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:41:42 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:41:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:41:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:41:46 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:46 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:41:47 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:41:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:41:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:41:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:41:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:41:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:41:56 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:41:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:41:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:41:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:41:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:41:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:41:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:41:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:41:58 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:41:58 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.182086944580078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 8b274e91-15bd-49c1-8fee-12908102ee15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:41:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:42:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:42:11 user nova-compute[76049]: INFO nova.compute.manager [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Terminating instance
Nov 15 11:42:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-859b0a59-3465-4f55-b86b-3b2d7cf5b240 req-6468016b-2b6b-4a62-9973-c012f57d755e service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-unplugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-859b0a59-3465-4f55-b86b-3b2d7cf5b240 req-6468016b-2b6b-4a62-9973-c012f57d755e service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-859b0a59-3465-4f55-b86b-3b2d7cf5b240 req-6468016b-2b6b-4a62-9973-c012f57d755e service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-859b0a59-3465-4f55-b86b-3b2d7cf5b240 req-6468016b-2b6b-4a62-9973-c012f57d755e service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-859b0a59-3465-4f55-b86b-3b2d7cf5b240 req-6468016b-2b6b-4a62-9973-c012f57d755e service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-unplugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-859b0a59-3465-4f55-b86b-3b2d7cf5b240 req-6468016b-2b6b-4a62-9973-c012f57d755e service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-unplugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Instance destroyed successfully.
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.objects.instance [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'resources' on Instance uuid 8b274e91-15bd-49c1-8fee-12908102ee15 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44323748',display_name='tempest-ServerRescueNegativeTestJSON-server-44323748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44323748',id=44,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-bfaao6du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:28:09Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=8b274e91-15bd-49c1-8fee-12908102ee15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "6ca7af5f-fb76-4126-924c-2fb495e47964", "address": "fa:16:3e:56:a1:c3", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca7af5f-fb", "ovs_interfaceid": "6ca7af5f-fb76-4126-924c-2fb495e47964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG os_vif [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ca7af5f-fb, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bed0831f-e226-45bd-ba5c-fba7162fb793) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:42:12 user nova-compute[76049]: INFO os_vif [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:a1:c3,bridge_name='br-int',has_traffic_filtering=True,id=6ca7af5f-fb76-4126-924c-2fb495e47964,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca7af5f-fb')
Nov 15 11:42:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Deleting instance files /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15_del
Nov 15 11:42:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Deletion of /opt/stack/data/nova/instances/8b274e91-15bd-49c1-8fee-12908102ee15_del complete
Nov 15 11:42:12 user nova-compute[76049]: INFO nova.compute.manager [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 11:42:12 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:42:12 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Took 0.46 seconds to deallocate network for instance.
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-ba657cec-e203-47e5-be72-aaf562bb46d2 req-47c6e8d5-4e60-4eb3-89ef-edeae2c4dbe1 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-deleted-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:42:12 user nova-compute[76049]: INFO nova.compute.manager [req-ba657cec-e203-47e5-be72-aaf562bb46d2 req-47c6e8d5-4e60-4eb3-89ef-edeae2c4dbe1 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Neutron deleted interface 6ca7af5f-fb76-4126-924c-2fb495e47964; detaching it from the instance and deleting it from the info cache
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-ba657cec-e203-47e5-be72-aaf562bb46d2 req-47c6e8d5-4e60-4eb3-89ef-edeae2c4dbe1 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-ba657cec-e203-47e5-be72-aaf562bb46d2 req-47c6e8d5-4e60-4eb3-89ef-edeae2c4dbe1 service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Detach interface failed, port_id=6ca7af5f-fb76-4126-924c-2fb495e47964, reason: Instance 8b274e91-15bd-49c1-8fee-12908102ee15 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:42:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:42:12 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Deleted allocations for instance 8b274e91-15bd-49c1-8fee-12908102ee15
Nov 15 11:42:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4eb4af24-ac27-44a0-b12c-0fe5f9e0729b tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "8b274e91-15bd-49c1-8fee-12908102ee15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:42:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-a3fa4fc2-24d4-4057-916d-f7570d38616b req-b49b8ac7-b19f-4204-aabe-4e48eb8d27be service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:42:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a3fa4fc2-24d4-4057-916d-f7570d38616b req-b49b8ac7-b19f-4204-aabe-4e48eb8d27be service nova] Acquiring lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:42:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a3fa4fc2-24d4-4057-916d-f7570d38616b req-b49b8ac7-b19f-4204-aabe-4e48eb8d27be service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:42:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-a3fa4fc2-24d4-4057-916d-f7570d38616b req-b49b8ac7-b19f-4204-aabe-4e48eb8d27be service nova] Lock "8b274e91-15bd-49c1-8fee-12908102ee15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:42:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-a3fa4fc2-24d4-4057-916d-f7570d38616b req-b49b8ac7-b19f-4204-aabe-4e48eb8d27be service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] No waiting events found dispatching network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:42:14 user nova-compute[76049]: WARNING nova.compute.manager [req-a3fa4fc2-24d4-4057-916d-f7570d38616b req-b49b8ac7-b19f-4204-aabe-4e48eb8d27be service nova] [instance: 8b274e91-15bd-49c1-8fee-12908102ee15] Received unexpected event network-vif-plugged-6ca7af5f-fb76-4126-924c-2fb495e47964 for instance with vm_state deleted and task_state None.
Nov 15 11:42:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:42:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:42:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:42:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:42:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:40 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [{"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-abc51297-8f1e-46d6-b1ae-843c34d7cbf3" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:42:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:42:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:42:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:42:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:42:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:42:57 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:42:58 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:42:58 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:42:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9051MB free_disk=25.20952606201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:42:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:43:02 user nova-compute[76049]: INFO nova.compute.manager [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Terminating instance
Nov 15 11:43:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6697fb76-ac23-4a4a-9304-c0deeaa45e16 req-50649e57-0934-43a8-ac2a-ddd4af6ebea5 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6697fb76-ac23-4a4a-9304-c0deeaa45e16 req-50649e57-0934-43a8-ac2a-ddd4af6ebea5 service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6697fb76-ac23-4a4a-9304-c0deeaa45e16 req-50649e57-0934-43a8-ac2a-ddd4af6ebea5 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6697fb76-ac23-4a4a-9304-c0deeaa45e16 req-50649e57-0934-43a8-ac2a-ddd4af6ebea5 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6697fb76-ac23-4a4a-9304-c0deeaa45e16 req-50649e57-0934-43a8-ac2a-ddd4af6ebea5 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6697fb76-ac23-4a4a-9304-c0deeaa45e16 req-50649e57-0934-43a8-ac2a-ddd4af6ebea5 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-unplugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Instance destroyed successfully.
Nov 15 11:43:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lazy-loading 'resources' on Instance uuid abc51297-8f1e-46d6-b1ae-843c34d7cbf3 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674425469',display_name='tempest-ServerRescueNegativeTestJSON-server-674425469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674425469',id=43,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde1d2d3e99a4c96ab95220df3de4ad4',ramdisk_id='',reservation_id='r-tmhj757s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-47045426',owner_user_name='tempest-ServerRescueNegativeTestJSON-47045426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:32:52Z,user_data=None,user_id='ab6a364f470c402bbd91712302c611cd',uuid=abc51297-8f1e-46d6-b1ae-843c34d7cbf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converting VIF {"id": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "address": "fa:16:3e:36:70:c7", "network": {"id": "3331820a-e518-4d8b-b46d-1dcbe96747f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020128301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde1d2d3e99a4c96ab95220df3de4ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd140bd-27", "ovs_interfaceid": "edd140bd-2737-4f7c-b54c-d59a6a2d7ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG os_vif [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd140bd-27, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd4b5355-91b1-45ae-9c81-8b6c33a5e64e) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:03 user nova-compute[76049]: INFO os_vif [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:c7,bridge_name='br-int',has_traffic_filtering=True,id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb,network=Network(3331820a-e518-4d8b-b46d-1dcbe96747f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd140bd-27')
Nov 15 11:43:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Deleting instance files /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3_del
Nov 15 11:43:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Deletion of /opt/stack/data/nova/instances/abc51297-8f1e-46d6-b1ae-843c34d7cbf3_del complete
Nov 15 11:43:03 user nova-compute[76049]: INFO nova.compute.manager [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 11:43:03 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:43:03 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Took 0.44 seconds to deallocate network for instance.
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-7315b47b-895d-4fe8-94b1-92f44deb18b7 req-1ab4e4fd-bfd6-4141-b980-fa038838e3bb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-deleted-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:43:03 user nova-compute[76049]: INFO nova.compute.manager [req-7315b47b-895d-4fe8-94b1-92f44deb18b7 req-1ab4e4fd-bfd6-4141-b980-fa038838e3bb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Neutron deleted interface edd140bd-2737-4f7c-b54c-d59a6a2d7ddb; detaching it from the instance and deleting it from the info cache
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.network.neutron [req-7315b47b-895d-4fe8-94b1-92f44deb18b7 req-1ab4e4fd-bfd6-4141-b980-fa038838e3bb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.compute.manager [req-7315b47b-895d-4fe8-94b1-92f44deb18b7 req-1ab4e4fd-bfd6-4141-b980-fa038838e3bb service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Detach interface failed, port_id=edd140bd-2737-4f7c-b54c-d59a6a2d7ddb, reason: Instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:43:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:43:03 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Deleted allocations for instance abc51297-8f1e-46d6-b1ae-843c34d7cbf3
Nov 15 11:43:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2ac129cf-6d47-4d18-a7a5-77bddaeb76eb tempest-ServerRescueNegativeTestJSON-47045426 tempest-ServerRescueNegativeTestJSON-47045426-project-member] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.574s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:43:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-c62f0033-80e8-4da2-ace9-60a7fea199ce req-9d5199df-e5b3-4e15-b0e2-7c92cae7b426 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:43:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c62f0033-80e8-4da2-ace9-60a7fea199ce req-9d5199df-e5b3-4e15-b0e2-7c92cae7b426 service nova] Acquiring lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:43:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c62f0033-80e8-4da2-ace9-60a7fea199ce req-9d5199df-e5b3-4e15-b0e2-7c92cae7b426 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:43:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-c62f0033-80e8-4da2-ace9-60a7fea199ce req-9d5199df-e5b3-4e15-b0e2-7c92cae7b426 service nova] Lock "abc51297-8f1e-46d6-b1ae-843c34d7cbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:43:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-c62f0033-80e8-4da2-ace9-60a7fea199ce req-9d5199df-e5b3-4e15-b0e2-7c92cae7b426 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] No waiting events found dispatching network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:43:04 user nova-compute[76049]: WARNING nova.compute.manager [req-c62f0033-80e8-4da2-ace9-60a7fea199ce req-9d5199df-e5b3-4e15-b0e2-7c92cae7b426 service nova] [instance: abc51297-8f1e-46d6-b1ae-843c34d7cbf3] Received unexpected event network-vif-plugged-edd140bd-2737-4f7c-b54c-d59a6a2d7ddb for instance with vm_state deleted and task_state None.
Nov 15 11:43:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:43:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:43:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:43:47 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:43:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:43:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:43:59 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:43:59 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:43:59 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9184MB free_disk=25.23664093017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:43:59 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:44:00 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:44:00 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:44:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:44:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:44:03 user nova-compute[76049]: INFO nova.compute.claims [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Claim successful on node user
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:44:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.policy [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d56b6bf3454404afb83a4e7181d6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d467c99c2c8405bb74574f4fbfc87ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:44:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Creating image(s)
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "/opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "/opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "/opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Successfully created port: 82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk 1073741824" returned: 0 in 0.053s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Cannot resize image /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Ensure instance console log exists: /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Successfully updated port: 82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received event network-changed-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Refreshing instance network info cache due to event network-changed-82079bd4-eafc-462e-9310-53a172a2e7dd. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Instance network_info: |[{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.neutron [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Refreshing network info cache for port 82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Start _get_guest_xml network_info=[{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:44:04 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:44:04 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:44:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1744700473',display_name='tempest-ServersNegativeTestJSON-server-1744700473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1744700473',id=49,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d467c99c2c8405bb74574f4fbfc87ec',ramdisk_id='',reservation_id='r-8xluqo50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-959896624',owner_user_name='tempest-ServersNegativeTestJSON-959896624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:44:03Z,user_data=None,user_id='d5d56b6bf3454404afb83a4e7181d6e8',uuid=1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converting VIF {"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:a1,bridge_name='br-int',has_traffic_filtering=True,id=82079bd4-eafc-462e-9310-53a172a2e7dd,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82079bd4-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lazy-loading 'pci_devices' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:44:04 user nova-compute[76049]:   <uuid>1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80</uuid>
Nov 15 11:44:04 user nova-compute[76049]:   <name>instance-00000031</name>
Nov 15 11:44:04 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:44:04 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:44:04 user nova-compute[76049]:   <metadata>
Nov 15 11:44:04 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:44:04 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:44:04 user nova-compute[76049]:       <nova:name>tempest-ServersNegativeTestJSON-server-1744700473</nova:name>
Nov 15 11:44:04 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:44:04</nova:creationTime>
Nov 15 11:44:04 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:44:04 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:44:04 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:44:04 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:44:04 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:44:04 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:44:04 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:44:04 user nova-compute[76049]:       <nova:owner>
Nov 15 11:44:04 user nova-compute[76049]:         <nova:user uuid="d5d56b6bf3454404afb83a4e7181d6e8">tempest-ServersNegativeTestJSON-959896624-project-member</nova:user>
Nov 15 11:44:04 user nova-compute[76049]:         <nova:project uuid="3d467c99c2c8405bb74574f4fbfc87ec">tempest-ServersNegativeTestJSON-959896624</nova:project>
Nov 15 11:44:04 user nova-compute[76049]:       </nova:owner>
Nov 15 11:44:04 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:44:04 user nova-compute[76049]:       <nova:ports>
Nov 15 11:44:04 user nova-compute[76049]:         <nova:port uuid="82079bd4-eafc-462e-9310-53a172a2e7dd">
Nov 15 11:44:04 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 11:44:04 user nova-compute[76049]:         </nova:port>
Nov 15 11:44:04 user nova-compute[76049]:       </nova:ports>
Nov 15 11:44:04 user nova-compute[76049]:     </nova:instance>
Nov 15 11:44:04 user nova-compute[76049]:   </metadata>
Nov 15 11:44:04 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:44:04 user nova-compute[76049]:     <system>
Nov 15 11:44:04 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:44:04 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:44:04 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:44:04 user nova-compute[76049]:       <entry name="serial">1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80</entry>
Nov 15 11:44:04 user nova-compute[76049]:       <entry name="uuid">1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80</entry>
Nov 15 11:44:04 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:44:04 user nova-compute[76049]:     </system>
Nov 15 11:44:04 user nova-compute[76049]:   </sysinfo>
Nov 15 11:44:04 user nova-compute[76049]:   <os>
Nov 15 11:44:04 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:44:04 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:44:04 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:44:04 user nova-compute[76049]:   </os>
Nov 15 11:44:04 user nova-compute[76049]:   <features>
Nov 15 11:44:04 user nova-compute[76049]:     <acpi/>
Nov 15 11:44:04 user nova-compute[76049]:     <apic/>
Nov 15 11:44:04 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:44:04 user nova-compute[76049]:   </features>
Nov 15 11:44:04 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:44:04 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:44:04 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:44:04 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:44:04 user nova-compute[76049]:   </clock>
Nov 15 11:44:04 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:44:04 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:44:04 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:44:04 user nova-compute[76049]:   </cpu>
Nov 15 11:44:04 user nova-compute[76049]:   <devices>
Nov 15 11:44:04 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:44:04 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:44:04 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk"/>
Nov 15 11:44:04 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:44:04 user nova-compute[76049]:     </disk>
Nov 15 11:44:04 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:44:04 user nova-compute[76049]:       <mac address="fa:16:3e:28:e7:a1"/>
Nov 15 11:44:04 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:44:04 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:44:04 user nova-compute[76049]:       <target dev="tap82079bd4-ea"/>
Nov 15 11:44:04 user nova-compute[76049]:     </interface>
Nov 15 11:44:04 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:44:04 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/console.log" append="off"/>
Nov 15 11:44:04 user nova-compute[76049]:     </serial>
Nov 15 11:44:04 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:44:04 user nova-compute[76049]:     <video>
Nov 15 11:44:04 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:44:04 user nova-compute[76049]:     </video>
Nov 15 11:44:04 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:44:04 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:44:04 user nova-compute[76049]:     </rng>
Nov 15 11:44:04 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:44:04 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:44:04 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:44:04 user nova-compute[76049]:     </memballoon>
Nov 15 11:44:04 user nova-compute[76049]:   </devices>
Nov 15 11:44:04 user nova-compute[76049]: </domain>
Nov 15 11:44:04 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:44:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1744700473',display_name='tempest-ServersNegativeTestJSON-server-1744700473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1744700473',id=49,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d467c99c2c8405bb74574f4fbfc87ec',ramdisk_id='',reservation_id='r-8xluqo50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-959896624',owner_user_name='tempest-ServersNegativeTestJSON-959896624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:44:03Z,user_data=None,user_id='d5d56b6bf3454404afb83a4e7181d6e8',uuid=1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converting VIF {"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:a1,bridge_name='br-int',has_traffic_filtering=True,id=82079bd4-eafc-462e-9310-53a172a2e7dd,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82079bd4-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG os_vif [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:a1,bridge_name='br-int',has_traffic_filtering=True,id=82079bd4-eafc-462e-9310-53a172a2e7dd,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82079bd4-ea') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1652a829-95dd-555c-91b5-e2e44b8c0595', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82079bd4-ea, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82079bd4-ea, col_values=(('qos', UUID('b96d9f92-28e6-4fba-a5d6-99c0e06b06d6')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82079bd4-ea, col_values=(('external_ids', {'iface-id': '82079bd4-eafc-462e-9310-53a172a2e7dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e7:a1', 'vm-uuid': '1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:04 user nova-compute[76049]: INFO os_vif [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:a1,bridge_name='br-int',has_traffic_filtering=True,id=82079bd4-eafc-462e-9310-53a172a2e7dd,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82079bd4-ea')
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:44:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] No VIF found with MAC fa:16:3e:28:e7:a1, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:44:05 user nova-compute[76049]: DEBUG nova.network.neutron [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated VIF entry in instance network info cache for port 82079bd4-eafc-462e-9310-53a172a2e7dd. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:44:05 user nova-compute[76049]: DEBUG nova.network.neutron [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:44:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-5fa84cb4-19a4-4794-84af-06391a8059a6 req-f1764f44-993a-4c9b-920b-aa57ebe6fadc service nova] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8b31b56-a489-4fca-a4de-ceee90fb265e req-c4b0ceac-7bc7-4b6c-913e-45fd82d09e25 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received event network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8b31b56-a489-4fca-a4de-ceee90fb265e req-c4b0ceac-7bc7-4b6c-913e-45fd82d09e25 service nova] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8b31b56-a489-4fca-a4de-ceee90fb265e req-c4b0ceac-7bc7-4b6c-913e-45fd82d09e25 service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8b31b56-a489-4fca-a4de-ceee90fb265e req-c4b0ceac-7bc7-4b6c-913e-45fd82d09e25 service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8b31b56-a489-4fca-a4de-ceee90fb265e req-c4b0ceac-7bc7-4b6c-913e-45fd82d09e25 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] No waiting events found dispatching network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:44:06 user nova-compute[76049]: WARNING nova.compute.manager [req-d8b31b56-a489-4fca-a4de-ceee90fb265e req-c4b0ceac-7bc7-4b6c-913e-45fd82d09e25 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received unexpected event network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd for instance with vm_state building and task_state spawning.
Nov 15 11:44:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:44:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Instance spawned successfully.
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:08 user nova-compute[76049]: INFO nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-e154bfe1-26ad-44ba-ab8b-57510e4478d1 req-57e2d677-97f2-4550-9e14-c7ec7f0c2fd0 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received event network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e154bfe1-26ad-44ba-ab8b-57510e4478d1 req-57e2d677-97f2-4550-9e14-c7ec7f0c2fd0 service nova] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e154bfe1-26ad-44ba-ab8b-57510e4478d1 req-57e2d677-97f2-4550-9e14-c7ec7f0c2fd0 service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e154bfe1-26ad-44ba-ab8b-57510e4478d1 req-57e2d677-97f2-4550-9e14-c7ec7f0c2fd0 service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:08 user nova-compute[76049]: DEBUG nova.compute.manager [req-e154bfe1-26ad-44ba-ab8b-57510e4478d1 req-57e2d677-97f2-4550-9e14-c7ec7f0c2fd0 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] No waiting events found dispatching network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:44:08 user nova-compute[76049]: WARNING nova.compute.manager [req-e154bfe1-26ad-44ba-ab8b-57510e4478d1 req-57e2d677-97f2-4550-9e14-c7ec7f0c2fd0 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received unexpected event network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd for instance with vm_state building and task_state spawning.
Nov 15 11:44:08 user nova-compute[76049]: INFO nova.compute.manager [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Took 5.50 seconds to build instance.
Nov 15 11:44:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5da53e3e-10d5-463d-a97b-d4f6d5ff28e8 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.602s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:44:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:42 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:44:45 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:44:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:44:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:44:45 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:44:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:44:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:44:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:44:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:44:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:44:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:44:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:44:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:44:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:44:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:44:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:44:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:44:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:01 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:02 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:45:02 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:45:02 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=25.206920623779297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:45:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Verify base images {{(pid=76049) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Image id 2b3c94d7-0d98-4e44-a0fb-491b41156c7f yields fingerprint ad486dc4e3d31affc829c29a1071ff49e55344dc {{(pid=76049) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] image 2b3c94d7-0d98-4e44-a0fb-491b41156c7f at (/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc): checking
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] image 2b3c94d7-0d98-4e44-a0fb-491b41156c7f at (/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc): image is in use {{(pid=76049) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=76049) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 is a valid instance name {{(pid=76049) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 has a disk file {{(pid=76049) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 is backed by ad486dc4e3d31affc829c29a1071ff49e55344dc {{(pid=76049) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229
Nov 15 11:45:09 user nova-compute[76049]: WARNING nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Unknown base file: /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Active base files: /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Removable base files: /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5 /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573 /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3 /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97 /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229 /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a26781926de5956f28972bcb0be89ad8aade90e5
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/266d207a7dbbf48ab5f88106a3e09b4cd3334573
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a594138462d080eac2d4a4bcf0de7b90ae8fa16a
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/534cecf3f83905ddd67b1b9e45daf952c8704df3
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0a9455d0d869efd4bb36a34ffc2cd8b629a7a95c
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50d11bf59fb1735bb67ffd6f4f15c8b71fda9d97
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/89730317cd756cd8cb82a48c13bf1a4bc0403229
Nov 15 11:45:09 user nova-compute[76049]: INFO nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/abcf3ae688a671b92f48ecdfe4e025262fb47cd4
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Verification complete {{(pid=76049) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Verify swap images {{(pid=76049) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.imagecache [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Verify ephemeral images {{(pid=76049) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 11:45:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:45:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:45:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:45:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:45:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:45:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:45:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:45:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:45:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:45:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:45:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:43 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:46 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:45:46 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:45:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:45:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:45:46 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:45:46 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:45:47 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:45:47 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:45:47 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:45:47 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:47 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:45:47 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:45:53 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:45:54 user nova-compute[76049]: INFO nova.compute.claims [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Claim successful on node user
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:45:54 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.policy [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d56b6bf3454404afb83a4e7181d6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d467c99c2c8405bb74574f4fbfc87ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:45:54 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Creating image(s)
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "/opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "/opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk 1073741824" returned: 0 in 0.047s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:54 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Successfully created port: 6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Cannot resize image /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Ensure instance console log exists: /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Successfully updated port: 6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "refresh_cache-6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquired lock "refresh_cache-6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received event network-changed-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.compute.manager [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Refreshing instance network info cache due to event network-changed-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] Acquiring lock "refresh_cache-6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:45:55 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Updating instance_info_cache with network_info: [{"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Releasing lock "refresh_cache-6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Instance network_info: |[{"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] Acquired lock "refresh_cache-6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.neutron [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Refreshing network info cache for port 6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Start _get_guest_xml network_info=[{"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:45:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:45:56 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1349971092',display_name='tempest-ServersNegativeTestJSON-server-1349971092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1349971092',id=50,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d467c99c2c8405bb74574f4fbfc87ec',ramdisk_id='',reservation_id='r-r5surdi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-959896624',owner_user_name='tempest-ServersNegativeTestJSON-959896624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:45:54Z,user_data=None,user_id='d5d56b6bf3454404afb83a4e7181d6e8',uuid=6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converting VIF {"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c33a0d9-b9a1-4ef6-9453-69ad07ab0949,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c33a0d9-b9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:45:56 user nova-compute[76049]:   <uuid>6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f</uuid>
Nov 15 11:45:56 user nova-compute[76049]:   <name>instance-00000032</name>
Nov 15 11:45:56 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:45:56 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:45:56 user nova-compute[76049]:   <metadata>
Nov 15 11:45:56 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:45:56 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:45:56 user nova-compute[76049]:       <nova:name>tempest-ServersNegativeTestJSON-server-1349971092</nova:name>
Nov 15 11:45:56 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:45:56</nova:creationTime>
Nov 15 11:45:56 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:45:56 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:45:56 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:45:56 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:45:56 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:45:56 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:45:56 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:45:56 user nova-compute[76049]:       <nova:owner>
Nov 15 11:45:56 user nova-compute[76049]:         <nova:user uuid="d5d56b6bf3454404afb83a4e7181d6e8">tempest-ServersNegativeTestJSON-959896624-project-member</nova:user>
Nov 15 11:45:56 user nova-compute[76049]:         <nova:project uuid="3d467c99c2c8405bb74574f4fbfc87ec">tempest-ServersNegativeTestJSON-959896624</nova:project>
Nov 15 11:45:56 user nova-compute[76049]:       </nova:owner>
Nov 15 11:45:56 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:45:56 user nova-compute[76049]:       <nova:ports>
Nov 15 11:45:56 user nova-compute[76049]:         <nova:port uuid="6c33a0d9-b9a1-4ef6-9453-69ad07ab0949">
Nov 15 11:45:56 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 11:45:56 user nova-compute[76049]:         </nova:port>
Nov 15 11:45:56 user nova-compute[76049]:       </nova:ports>
Nov 15 11:45:56 user nova-compute[76049]:     </nova:instance>
Nov 15 11:45:56 user nova-compute[76049]:   </metadata>
Nov 15 11:45:56 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:45:56 user nova-compute[76049]:     <system>
Nov 15 11:45:56 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:45:56 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:45:56 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:45:56 user nova-compute[76049]:       <entry name="serial">6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f</entry>
Nov 15 11:45:56 user nova-compute[76049]:       <entry name="uuid">6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f</entry>
Nov 15 11:45:56 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:45:56 user nova-compute[76049]:     </system>
Nov 15 11:45:56 user nova-compute[76049]:   </sysinfo>
Nov 15 11:45:56 user nova-compute[76049]:   <os>
Nov 15 11:45:56 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:45:56 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:45:56 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:45:56 user nova-compute[76049]:   </os>
Nov 15 11:45:56 user nova-compute[76049]:   <features>
Nov 15 11:45:56 user nova-compute[76049]:     <acpi/>
Nov 15 11:45:56 user nova-compute[76049]:     <apic/>
Nov 15 11:45:56 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:45:56 user nova-compute[76049]:   </features>
Nov 15 11:45:56 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:45:56 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:45:56 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:45:56 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:45:56 user nova-compute[76049]:   </clock>
Nov 15 11:45:56 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:45:56 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:45:56 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:45:56 user nova-compute[76049]:   </cpu>
Nov 15 11:45:56 user nova-compute[76049]:   <devices>
Nov 15 11:45:56 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:45:56 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:45:56 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk"/>
Nov 15 11:45:56 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:45:56 user nova-compute[76049]:     </disk>
Nov 15 11:45:56 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:45:56 user nova-compute[76049]:       <mac address="fa:16:3e:28:42:3e"/>
Nov 15 11:45:56 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:45:56 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:45:56 user nova-compute[76049]:       <target dev="tap6c33a0d9-b9"/>
Nov 15 11:45:56 user nova-compute[76049]:     </interface>
Nov 15 11:45:56 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:45:56 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/console.log" append="off"/>
Nov 15 11:45:56 user nova-compute[76049]:     </serial>
Nov 15 11:45:56 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:45:56 user nova-compute[76049]:     <video>
Nov 15 11:45:56 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:45:56 user nova-compute[76049]:     </video>
Nov 15 11:45:56 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:45:56 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:45:56 user nova-compute[76049]:     </rng>
Nov 15 11:45:56 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:45:56 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:45:56 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:45:56 user nova-compute[76049]:     </memballoon>
Nov 15 11:45:56 user nova-compute[76049]:   </devices>
Nov 15 11:45:56 user nova-compute[76049]: </domain>
Nov 15 11:45:56 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1349971092',display_name='tempest-ServersNegativeTestJSON-server-1349971092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1349971092',id=50,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d467c99c2c8405bb74574f4fbfc87ec',ramdisk_id='',reservation_id='r-r5surdi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-959896624',owner_user_name='tempest-ServersNegativeTestJSON-959896624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:45:54Z,user_data=None,user_id='d5d56b6bf3454404afb83a4e7181d6e8',uuid=6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converting VIF {"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c33a0d9-b9a1-4ef6-9453-69ad07ab0949,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c33a0d9-b9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG os_vif [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c33a0d9-b9a1-4ef6-9453-69ad07ab0949,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c33a0d9-b9') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7c2e5a5-af0d-55b1-9866-70dfae7dd423', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c33a0d9-b9, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c33a0d9-b9, col_values=(('qos', UUID('d35b95a4-d4fd-453b-b1c8-093807eac5e0')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c33a0d9-b9, col_values=(('external_ids', {'iface-id': '6c33a0d9-b9a1-4ef6-9453-69ad07ab0949', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:42:3e', 'vm-uuid': '6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:56 user nova-compute[76049]: INFO os_vif [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c33a0d9-b9a1-4ef6-9453-69ad07ab0949,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c33a0d9-b9')
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] No VIF found with MAC fa:16:3e:28:42:3e, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.neutron [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Updated VIF entry in instance network info cache for port 6c33a0d9-b9a1-4ef6-9453-69ad07ab0949. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG nova.network.neutron [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Updating instance_info_cache with network_info: [{"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:45:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-0c5df1f1-41d3-4537-863d-3a20259791c0 req-c9e775c9-a910-467c-a171-d770a5eb2bf1 service nova] Releasing lock "refresh_cache-6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-3811e698-04b0-49c8-8a15-909ea1d56e72 req-2e0b7f6f-bdfd-42b1-8e38-f796b4334cd4 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received event network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3811e698-04b0-49c8-8a15-909ea1d56e72 req-2e0b7f6f-bdfd-42b1-8e38-f796b4334cd4 service nova] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3811e698-04b0-49c8-8a15-909ea1d56e72 req-2e0b7f6f-bdfd-42b1-8e38-f796b4334cd4 service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-3811e698-04b0-49c8-8a15-909ea1d56e72 req-2e0b7f6f-bdfd-42b1-8e38-f796b4334cd4 service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-3811e698-04b0-49c8-8a15-909ea1d56e72 req-2e0b7f6f-bdfd-42b1-8e38-f796b4334cd4 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] No waiting events found dispatching network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:45:57 user nova-compute[76049]: WARNING nova.compute.manager [req-3811e698-04b0-49c8-8a15-909ea1d56e72 req-2e0b7f6f-bdfd-42b1-8e38-f796b4334cd4 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received unexpected event network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 for instance with vm_state building and task_state spawning.
Nov 15 11:45:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:45:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:45:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:45:59 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Instance spawned successfully.
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:45:59 user nova-compute[76049]: INFO nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb8f858a-69f5-4f13-b502-4ece579955c6 req-36fe46fb-cc15-422c-a92a-6e73695061ab service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received event network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb8f858a-69f5-4f13-b502-4ece579955c6 req-36fe46fb-cc15-422c-a92a-6e73695061ab service nova] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb8f858a-69f5-4f13-b502-4ece579955c6 req-36fe46fb-cc15-422c-a92a-6e73695061ab service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-fb8f858a-69f5-4f13-b502-4ece579955c6 req-36fe46fb-cc15-422c-a92a-6e73695061ab service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:45:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-fb8f858a-69f5-4f13-b502-4ece579955c6 req-36fe46fb-cc15-422c-a92a-6e73695061ab service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] No waiting events found dispatching network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:45:59 user nova-compute[76049]: WARNING nova.compute.manager [req-fb8f858a-69f5-4f13-b502-4ece579955c6 req-36fe46fb-cc15-422c-a92a-6e73695061ab service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received unexpected event network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 for instance with vm_state building and task_state spawning.
Nov 15 11:45:59 user nova-compute[76049]: INFO nova.compute.manager [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Took 5.71 seconds to build instance.
Nov 15 11:45:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1f2aa092-3bf7-49cd-8207-f254e01f1292 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.800s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:46:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:46:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:46:04 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:46:04 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.205318450927734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:46:04 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:46:05 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:46:05 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:46:05 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:46:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:46:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:46:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:46:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:46:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:08 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:46:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:46:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:46:44 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:46:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:46:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:46:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:46:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:46:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:46:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:46:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:46:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:46:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:46:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:46:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_power_states {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:47:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:47:04 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:47:05 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:47:05 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.169105529785156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:47:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:47:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:47:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:47:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:47:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:47:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:44 user nova-compute[76049]: INFO nova.compute.manager [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Terminating instance
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-126b372b-7c34-4bde-bb2d-b54c07a7cd67 req-b2eb3077-1e05-4bff-99a5-8032f9bd9694 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received event network-vif-unplugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-126b372b-7c34-4bde-bb2d-b54c07a7cd67 req-b2eb3077-1e05-4bff-99a5-8032f9bd9694 service nova] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-126b372b-7c34-4bde-bb2d-b54c07a7cd67 req-b2eb3077-1e05-4bff-99a5-8032f9bd9694 service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-126b372b-7c34-4bde-bb2d-b54c07a7cd67 req-b2eb3077-1e05-4bff-99a5-8032f9bd9694 service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-126b372b-7c34-4bde-bb2d-b54c07a7cd67 req-b2eb3077-1e05-4bff-99a5-8032f9bd9694 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] No waiting events found dispatching network-vif-unplugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-126b372b-7c34-4bde-bb2d-b54c07a7cd67 req-b2eb3077-1e05-4bff-99a5-8032f9bd9694 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received event network-vif-unplugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Instance destroyed successfully.
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.objects.instance [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lazy-loading 'resources' on Instance uuid 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1349971092',display_name='tempest-ServersNegativeTestJSON-server-1349971092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1349971092',id=50,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:45:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d467c99c2c8405bb74574f4fbfc87ec',ramdisk_id='',reservation_id='r-r5surdi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-959896624',owner_user_name='tempest-ServersNegativeTestJSON-959896624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:46:00Z,user_data=None,user_id='d5d56b6bf3454404afb83a4e7181d6e8',uuid=6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converting VIF {"id": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "address": "fa:16:3e:28:42:3e", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c33a0d9-b9", "ovs_interfaceid": "6c33a0d9-b9a1-4ef6-9453-69ad07ab0949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c33a0d9-b9a1-4ef6-9453-69ad07ab0949,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c33a0d9-b9') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG os_vif [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c33a0d9-b9a1-4ef6-9453-69ad07ab0949,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c33a0d9-b9') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c33a0d9-b9, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d35b95a4-d4fd-453b-b1c8-093807eac5e0) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:47:44 user nova-compute[76049]: INFO os_vif [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c33a0d9-b9a1-4ef6-9453-69ad07ab0949,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c33a0d9-b9')
Nov 15 11:47:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Deleting instance files /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f_del
Nov 15 11:47:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Deletion of /opt/stack/data/nova/instances/6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f_del complete
Nov 15 11:47:44 user nova-compute[76049]: INFO nova.compute.manager [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 11:47:44 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:47:44 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:47:45 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:47:45 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Took 0.47 seconds to deallocate network for instance.
Nov 15 11:47:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:45 user nova-compute[76049]: DEBUG nova.compute.manager [req-47b11f94-c0d5-4dba-84d5-0b6b566c47b3 req-6757f01a-4bde-42c2-87e8-990330bcafe2 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received event network-vif-deleted-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:47:45 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:47:45 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:47:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:45 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Deleted allocations for instance 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f
Nov 15 11:47:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-2e265a4b-b075-407e-bcdb-dadea8696ce6 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.488s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:45 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-21bc2014-7f7b-4551-bb87-cce8752959d3 req-779ff112-56f7-4d1d-8de9-d84981df7ae0 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received event network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:47:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-21bc2014-7f7b-4551-bb87-cce8752959d3 req-779ff112-56f7-4d1d-8de9-d84981df7ae0 service nova] Acquiring lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:47:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-21bc2014-7f7b-4551-bb87-cce8752959d3 req-779ff112-56f7-4d1d-8de9-d84981df7ae0 service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:47:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-21bc2014-7f7b-4551-bb87-cce8752959d3 req-779ff112-56f7-4d1d-8de9-d84981df7ae0 service nova] Lock "6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:47:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-21bc2014-7f7b-4551-bb87-cce8752959d3 req-779ff112-56f7-4d1d-8de9-d84981df7ae0 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] No waiting events found dispatching network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:47:46 user nova-compute[76049]: WARNING nova.compute.manager [req-21bc2014-7f7b-4551-bb87-cce8752959d3 req-779ff112-56f7-4d1d-8de9-d84981df7ae0 service nova] [instance: 6ab4ed51-b84b-457f-88d1-2cfbe5f6fb4f] Received unexpected event network-vif-plugged-6c33a0d9-b9a1-4ef6-9453-69ad07ab0949 for instance with vm_state deleted and task_state None.
Nov 15 11:47:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:47:48 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:47:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:47:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:47:55 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:47:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:48:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:48:06 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:48:06 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:48:06 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=25.196331024169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:48:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:48:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:48:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:48:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:48:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:48:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:48:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:48:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:48:46 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:48:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:48:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:48:55 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:48:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:48:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:49:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:49:08 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:49:08 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:49:08 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=25.195758819580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:49:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:49:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:49:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:49:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:50 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:49:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:49:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:49:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:49:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:49:59 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:49:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:50:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:50:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:50:09 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:50:09 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:50:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9059MB free_disk=25.195125579833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:50:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:50:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:50:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:50:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:50:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:50:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:50:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:48 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:50:49 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:50:50 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:50:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:50:50 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:50:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:53 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:50:53 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:50:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:50:55 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:50:59 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:50:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:51:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:51:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:51:09 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:51:09 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9070MB free_disk=25.194580078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:51:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:51:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:49 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [{"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:51:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:51:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:51:59 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:51:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:52:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:52:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:52:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:52:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:52:10 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9072MB free_disk=25.193965911865234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:52:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:52:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:22 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:52:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:52:43 user nova-compute[76049]: INFO nova.compute.manager [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Terminating instance
Nov 15 11:52:43 user nova-compute[76049]: DEBUG nova.compute.manager [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Instance destroyed successfully.
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.objects.instance [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lazy-loading 'resources' on Instance uuid 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:44:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1744700473',display_name='tempest-ServersNegativeTestJSON-server-1744700473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1744700473',id=49,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d467c99c2c8405bb74574f4fbfc87ec',ramdisk_id='',reservation_id='r-8xluqo50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-959896624',owner_user_name='tempest-ServersNegativeTestJSON-959896624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:44:09Z,user_data=None,user_id='d5d56b6bf3454404afb83a4e7181d6e8',uuid=1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converting VIF {"id": "82079bd4-eafc-462e-9310-53a172a2e7dd", "address": "fa:16:3e:28:e7:a1", "network": {"id": "c0b82e5d-4bf0-439a-b617-208a59d59f4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-516465689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d467c99c2c8405bb74574f4fbfc87ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82079bd4-ea", "ovs_interfaceid": "82079bd4-eafc-462e-9310-53a172a2e7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:a1,bridge_name='br-int',has_traffic_filtering=True,id=82079bd4-eafc-462e-9310-53a172a2e7dd,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82079bd4-ea') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG os_vif [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:a1,bridge_name='br-int',has_traffic_filtering=True,id=82079bd4-eafc-462e-9310-53a172a2e7dd,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82079bd4-ea') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82079bd4-ea, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b96d9f92-28e6-4fba-a5d6-99c0e06b06d6) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:52:44 user nova-compute[76049]: INFO os_vif [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:a1,bridge_name='br-int',has_traffic_filtering=True,id=82079bd4-eafc-462e-9310-53a172a2e7dd,network=Network(c0b82e5d-4bf0-439a-b617-208a59d59f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82079bd4-ea')
Nov 15 11:52:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Deleting instance files /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80_del
Nov 15 11:52:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Deletion of /opt/stack/data/nova/instances/1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80_del complete
Nov 15 11:52:44 user nova-compute[76049]: INFO nova.compute.manager [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 15 11:52:44 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-280e13f8-7073-4be3-8f5f-118815b21b80 req-74389673-ef19-4dbc-942f-dacafd8c8339 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received event network-vif-unplugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-280e13f8-7073-4be3-8f5f-118815b21b80 req-74389673-ef19-4dbc-942f-dacafd8c8339 service nova] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-280e13f8-7073-4be3-8f5f-118815b21b80 req-74389673-ef19-4dbc-942f-dacafd8c8339 service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-280e13f8-7073-4be3-8f5f-118815b21b80 req-74389673-ef19-4dbc-942f-dacafd8c8339 service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-280e13f8-7073-4be3-8f5f-118815b21b80 req-74389673-ef19-4dbc-942f-dacafd8c8339 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] No waiting events found dispatching network-vif-unplugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-280e13f8-7073-4be3-8f5f-118815b21b80 req-74389673-ef19-4dbc-942f-dacafd8c8339 service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received event network-vif-unplugged-82079bd4-eafc-462e-9310-53a172a2e7dd for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:52:44 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Took 0.48 seconds to deallocate network for instance.
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-d49880f9-0a0a-4e20-8b98-03a232b2467b req-c49a4379-53b7-4b12-a376-fe8e6a52679c service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received event network-vif-deleted-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:52:44 user nova-compute[76049]: INFO nova.compute.manager [req-d49880f9-0a0a-4e20-8b98-03a232b2467b req-c49a4379-53b7-4b12-a376-fe8e6a52679c service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Neutron deleted interface 82079bd4-eafc-462e-9310-53a172a2e7dd; detaching it from the instance and deleting it from the info cache
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.network.neutron [req-d49880f9-0a0a-4e20-8b98-03a232b2467b req-c49a4379-53b7-4b12-a376-fe8e6a52679c service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-d49880f9-0a0a-4e20-8b98-03a232b2467b req-c49a4379-53b7-4b12-a376-fe8e6a52679c service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Detach interface failed, port_id=82079bd4-eafc-462e-9310-53a172a2e7dd, reason: Instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80 could not be found. {{(pid=76049) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:52:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:52:45 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Deleted allocations for instance 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80
Nov 15 11:52:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-010caef7-a369-44b3-81fc-528c5c5c0f32 tempest-ServersNegativeTestJSON-959896624 tempest-ServersNegativeTestJSON-959896624-project-member] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.475s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:52:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-da055108-47f5-4095-9b8e-23bf78a8afb5 req-9dae9b71-8c8d-4f9e-be0e-6bf92a92eeda service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received event network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:52:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-da055108-47f5-4095-9b8e-23bf78a8afb5 req-9dae9b71-8c8d-4f9e-be0e-6bf92a92eeda service nova] Acquiring lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:52:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-da055108-47f5-4095-9b8e-23bf78a8afb5 req-9dae9b71-8c8d-4f9e-be0e-6bf92a92eeda service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:52:46 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-da055108-47f5-4095-9b8e-23bf78a8afb5 req-9dae9b71-8c8d-4f9e-be0e-6bf92a92eeda service nova] Lock "1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:52:46 user nova-compute[76049]: DEBUG nova.compute.manager [req-da055108-47f5-4095-9b8e-23bf78a8afb5 req-9dae9b71-8c8d-4f9e-be0e-6bf92a92eeda service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] No waiting events found dispatching network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:52:46 user nova-compute[76049]: WARNING nova.compute.manager [req-da055108-47f5-4095-9b8e-23bf78a8afb5 req-9dae9b71-8c8d-4f9e-be0e-6bf92a92eeda service nova] [instance: 1277aafd-9b32-4eaf-ab0d-be7f6e4e3a80] Received unexpected event network-vif-plugged-82079bd4-eafc-462e-9310-53a172a2e7dd for instance with vm_state deleted and task_state None.
Nov 15 11:52:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:52:50 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:52:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:52:51 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:52:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:52:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:52:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:52:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:53:01 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:01 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:53:11 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:53:11 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:53:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9193MB free_disk=25.221084594726562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:53:11 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:53:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:53:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:53:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:19 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:53:24 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:53:29 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:53:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:53:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:53:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:53:34 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:39 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:44 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:49 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:53:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:53:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:53:52 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 11:53:53 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:54 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:53:59 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:59 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:53:59 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:53:59 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:01 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:03 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:04 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:54:08 user nova-compute[76049]: INFO nova.compute.claims [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Claim successful on node user
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:54:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.policy [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0374d48d734a444b9bc2a710e67ca796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d66186abd51473a98eaa60ec235731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:54:08 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Creating image(s)
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "/opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "/opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "/opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk 1073741824" returned: 0 in 0.066s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG nova.network.neutron [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Successfully created port: c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Cannot resize image /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Ensure instance console log exists: /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG nova.network.neutron [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Successfully updated port: c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:54:09 user nova-compute[76049]: DEBUG nova.network.neutron [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-changed-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.compute.manager [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Refreshing instance network info cache due to event network-changed-c02b3756-d520-426a-9cc9-1b9f5b7480a3. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Instance network_info: |[{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.network.neutron [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Refreshing network info cache for port c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Start _get_guest_xml network_info=[{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:54:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:54:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1077786327',display_name='tempest-TestStampPattern-server-1077786327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1077786327',id=51,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy6K93O6FTQBt5mSx6WmCeWol2ftFrL4nqKzJ0Ty72ZgnuQoUGBOCS7Ht96k8KTZXbwb639733T9YE6RiKwcrs33RPkNwx7THtw8iSJnJTHCX+6s5uUB/Nz6SUWMVkAhg==',key_name='tempest-TestStampPattern-1239994036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d66186abd51473a98eaa60ec235731e',ramdisk_id='',reservation_id='r-rsurfmw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-516077703',owner_user_name='tempest-TestStampPattern-516077703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:54:09Z,user_data=None,user_id='0374d48d734a444b9bc2a710e67ca796',uuid=caf17d31-fac7-41bb-88c7-904561e6bb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converting VIF {"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=c02b3756-d520-426a-9cc9-1b9f5b7480a3,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02b3756-d5') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.objects.instance [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'pci_devices' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:54:10 user nova-compute[76049]:   <uuid>caf17d31-fac7-41bb-88c7-904561e6bb14</uuid>
Nov 15 11:54:10 user nova-compute[76049]:   <name>instance-00000033</name>
Nov 15 11:54:10 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:54:10 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:54:10 user nova-compute[76049]:   <metadata>
Nov 15 11:54:10 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:54:10 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:54:10 user nova-compute[76049]:       <nova:name>tempest-TestStampPattern-server-1077786327</nova:name>
Nov 15 11:54:10 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:54:10</nova:creationTime>
Nov 15 11:54:10 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:54:10 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:54:10 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:54:10 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:54:10 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:54:10 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:54:10 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:54:10 user nova-compute[76049]:       <nova:owner>
Nov 15 11:54:10 user nova-compute[76049]:         <nova:user uuid="0374d48d734a444b9bc2a710e67ca796">tempest-TestStampPattern-516077703-project-member</nova:user>
Nov 15 11:54:10 user nova-compute[76049]:         <nova:project uuid="3d66186abd51473a98eaa60ec235731e">tempest-TestStampPattern-516077703</nova:project>
Nov 15 11:54:10 user nova-compute[76049]:       </nova:owner>
Nov 15 11:54:10 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 11:54:10 user nova-compute[76049]:       <nova:ports>
Nov 15 11:54:10 user nova-compute[76049]:         <nova:port uuid="c02b3756-d520-426a-9cc9-1b9f5b7480a3">
Nov 15 11:54:10 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 11:54:10 user nova-compute[76049]:         </nova:port>
Nov 15 11:54:10 user nova-compute[76049]:       </nova:ports>
Nov 15 11:54:10 user nova-compute[76049]:     </nova:instance>
Nov 15 11:54:10 user nova-compute[76049]:   </metadata>
Nov 15 11:54:10 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:54:10 user nova-compute[76049]:     <system>
Nov 15 11:54:10 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:54:10 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:54:10 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:54:10 user nova-compute[76049]:       <entry name="serial">caf17d31-fac7-41bb-88c7-904561e6bb14</entry>
Nov 15 11:54:10 user nova-compute[76049]:       <entry name="uuid">caf17d31-fac7-41bb-88c7-904561e6bb14</entry>
Nov 15 11:54:10 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:54:10 user nova-compute[76049]:     </system>
Nov 15 11:54:10 user nova-compute[76049]:   </sysinfo>
Nov 15 11:54:10 user nova-compute[76049]:   <os>
Nov 15 11:54:10 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:54:10 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:54:10 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:54:10 user nova-compute[76049]:   </os>
Nov 15 11:54:10 user nova-compute[76049]:   <features>
Nov 15 11:54:10 user nova-compute[76049]:     <acpi/>
Nov 15 11:54:10 user nova-compute[76049]:     <apic/>
Nov 15 11:54:10 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:54:10 user nova-compute[76049]:   </features>
Nov 15 11:54:10 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:54:10 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:54:10 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:54:10 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:54:10 user nova-compute[76049]:   </clock>
Nov 15 11:54:10 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:54:10 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:54:10 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:54:10 user nova-compute[76049]:   </cpu>
Nov 15 11:54:10 user nova-compute[76049]:   <devices>
Nov 15 11:54:10 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:54:10 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:54:10 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk"/>
Nov 15 11:54:10 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:54:10 user nova-compute[76049]:     </disk>
Nov 15 11:54:10 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:54:10 user nova-compute[76049]:       <mac address="fa:16:3e:92:9d:d6"/>
Nov 15 11:54:10 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:54:10 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:54:10 user nova-compute[76049]:       <target dev="tapc02b3756-d5"/>
Nov 15 11:54:10 user nova-compute[76049]:     </interface>
Nov 15 11:54:10 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:54:10 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/console.log" append="off"/>
Nov 15 11:54:10 user nova-compute[76049]:     </serial>
Nov 15 11:54:10 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:54:10 user nova-compute[76049]:     <video>
Nov 15 11:54:10 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:54:10 user nova-compute[76049]:     </video>
Nov 15 11:54:10 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:54:10 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:54:10 user nova-compute[76049]:     </rng>
Nov 15 11:54:10 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:54:10 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:54:10 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:54:10 user nova-compute[76049]:     </memballoon>
Nov 15 11:54:10 user nova-compute[76049]:   </devices>
Nov 15 11:54:10 user nova-compute[76049]: </domain>
Nov 15 11:54:10 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1077786327',display_name='tempest-TestStampPattern-server-1077786327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1077786327',id=51,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy6K93O6FTQBt5mSx6WmCeWol2ftFrL4nqKzJ0Ty72ZgnuQoUGBOCS7Ht96k8KTZXbwb639733T9YE6RiKwcrs33RPkNwx7THtw8iSJnJTHCX+6s5uUB/Nz6SUWMVkAhg==',key_name='tempest-TestStampPattern-1239994036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d66186abd51473a98eaa60ec235731e',ramdisk_id='',reservation_id='r-rsurfmw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-516077703',owner_user_name='tempest-TestStampPattern-516077703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:54:09Z,user_data=None,user_id='0374d48d734a444b9bc2a710e67ca796',uuid=caf17d31-fac7-41bb-88c7-904561e6bb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converting VIF {"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=c02b3756-d520-426a-9cc9-1b9f5b7480a3,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02b3756-d5') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG os_vif [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=c02b3756-d520-426a-9cc9-1b9f5b7480a3,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02b3756-d5') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '655f054a-0810-52a7-b54c-8b99b33d751e', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc02b3756-d5, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc02b3756-d5, col_values=(('qos', UUID('28c91d79-1919-4921-ae8c-631ac322c32c')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc02b3756-d5, col_values=(('external_ids', {'iface-id': 'c02b3756-d520-426a-9cc9-1b9f5b7480a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:9d:d6', 'vm-uuid': 'caf17d31-fac7-41bb-88c7-904561e6bb14'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:10 user nova-compute[76049]: INFO os_vif [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=c02b3756-d520-426a-9cc9-1b9f5b7480a3,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02b3756-d5')
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:54:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No VIF found with MAC fa:16:3e:92:9d:d6, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated VIF entry in instance network info cache for port c02b3756-d520-426a-9cc9-1b9f5b7480a3. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG nova.network.neutron [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-d8a7930c-d240-4ca8-bf43-6bd086330856 req-795895fd-8130-4506-9316-513d33bb6f16 service nova] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-2c1c0d87-e1c4-442f-a8af-13f53c5fcbde req-536c1880-4bb6-4b0d-80b9-7bc8cecf53cd service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2c1c0d87-e1c4-442f-a8af-13f53c5fcbde req-536c1880-4bb6-4b0d-80b9-7bc8cecf53cd service nova] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2c1c0d87-e1c4-442f-a8af-13f53c5fcbde req-536c1880-4bb6-4b0d-80b9-7bc8cecf53cd service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-2c1c0d87-e1c4-442f-a8af-13f53c5fcbde req-536c1880-4bb6-4b0d-80b9-7bc8cecf53cd service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG nova.compute.manager [req-2c1c0d87-e1c4-442f-a8af-13f53c5fcbde req-536c1880-4bb6-4b0d-80b9-7bc8cecf53cd service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] No waiting events found dispatching network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:54:12 user nova-compute[76049]: WARNING nova.compute.manager [req-2c1c0d87-e1c4-442f-a8af-13f53c5fcbde req-536c1880-4bb6-4b0d-80b9-7bc8cecf53cd service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received unexpected event network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 for instance with vm_state building and task_state spawning.
Nov 15 11:54:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:54:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:54:13 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:54:13 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9130MB free_disk=25.209957122802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance caf17d31-fac7-41bb-88c7-904561e6bb14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:54:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Instance spawned successfully.
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:54:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:54:14 user nova-compute[76049]: INFO nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 15 11:54:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:54:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-7a2fc8ed-1dc7-45bb-9316-7aad6f18a15c req-751b50a2-00ef-4e6d-8916-788ba40c4ee6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:54:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7a2fc8ed-1dc7-45bb-9316-7aad6f18a15c req-751b50a2-00ef-4e6d-8916-788ba40c4ee6 service nova] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:54:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7a2fc8ed-1dc7-45bb-9316-7aad6f18a15c req-751b50a2-00ef-4e6d-8916-788ba40c4ee6 service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:54:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7a2fc8ed-1dc7-45bb-9316-7aad6f18a15c req-751b50a2-00ef-4e6d-8916-788ba40c4ee6 service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-7a2fc8ed-1dc7-45bb-9316-7aad6f18a15c req-751b50a2-00ef-4e6d-8916-788ba40c4ee6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] No waiting events found dispatching network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:54:14 user nova-compute[76049]: WARNING nova.compute.manager [req-7a2fc8ed-1dc7-45bb-9316-7aad6f18a15c req-751b50a2-00ef-4e6d-8916-788ba40c4ee6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received unexpected event network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 for instance with vm_state building and task_state spawning.
Nov 15 11:54:14 user nova-compute[76049]: INFO nova.compute.manager [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Took 5.93 seconds to build instance.
Nov 15 11:54:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-38a961e7-1df6-41dc-a8fc-5e7e68a6405d tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.024s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:54:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:54:51 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:54:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:54:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:54:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:54:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:54:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:54:55 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:54:55 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:54:55 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:54:55 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:54:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:05 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:55:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:55:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:55:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:55:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:55:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=25.181041717529297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance caf17d31-fac7-41bb-88c7-904561e6bb14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:55:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:55:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:55:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:53 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:55:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:55:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:55:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:55:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:55:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:55:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:55:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-changed-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:55:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Refreshing instance network info cache due to event network-changed-c02b3756-d520-426a-9cc9-1b9f5b7480a3. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:55:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:55:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:55:59 user nova-compute[76049]: DEBUG nova.network.neutron [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Refreshing network info cache for port c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG nova.network.neutron [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated VIF entry in instance network info cache for port c02b3756-d520-426a-9cc9-1b9f5b7480a3. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG nova.network.neutron [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-51e171da-856c-49ae-8858-24a2f8ce59f3 req-3efeabf2-ba2d-4bdf-a08c-43e365218cb6 service nova] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG nova.objects.instance [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'flavor' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:56:00 user nova-compute[76049]: INFO nova.compute.manager [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Attaching volume b8128d21-fb2a-4918-acfd-481cc2da3528 to /dev/vdb
Nov 15 11:56:00 user nova-compute[76049]: DEBUG os_brick.utils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e4e2fa-52dc-42d3-93f7-dd14575f4f84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd00efce-63c4-4018-ae48-4abf998a08ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b27e2ed-f9e1-4f58-af91-340652d1ece1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d680dcfc-94e5-4bf4-ae35-55462493b021]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:56:00 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:56:00 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f67fe4-b379-4049-8f4c-6ab9b1c7b9f8]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG os_brick.utils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating existing volume attachment record: e8df70fa-1ce7-4f71-86d4-9e83d288e93a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:56:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:56:03 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:03 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 11:56:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 11:56:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCQiAMRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:56:05 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:56:05 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:56:05 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b479de42-b9f9-4709-83e6-6ba2b4ab9d23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:56:05 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062b70a-0f84-4340-9414-027a315bc043]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528] added
Nov 15 11:56:05 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3001367e-a55a-443e-a28b-e24a7c2fc43b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf3fac-ede9-44c7-95cf-3e9e95a38df2]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FCQiAMRL {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FCQiAMRL" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f58859-ddb3-46eb-845f-58c8c72a7db6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FCQiAMRL'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2afc53-75ed-4ccf-989c-c3a9e88b4f53]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4553eeff-6f5d-4955-b1cb-7c372fad4db5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:56:05 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:56:05 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:56:05 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 11:56:05 user nova-compute[76049]: 
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd2dc88-076c-414c-878a-4c3c83ca85b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260]
Nov 15 11:56:05 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260] successful.
Nov 15 11:56:05 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a7fb43-48cd-4296-9845-5bfbe7b7f7d7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cd57a0-59fd-4c29-b326-f7b2ff0ba356]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 (non-flash)
Nov 15 11:56:05 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 (non-flash)
Nov 15 11:56:05 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f26d97-7f28-464d-b93e-d524e6cef463]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCQiAMRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:56:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23031626139656330', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031626139656330', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG nova.objects.instance [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'flavor' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:56:06 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:56:06 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:56:06 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:56:06 user nova-compute[76049]:   <serial>b8128d21-fb2a-4918-acfd-481cc2da3528</serial>
Nov 15 11:56:06 user nova-compute[76049]: </disk>
Nov 15 11:56:06 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No VIF found with MAC fa:16:3e:92:9d:d6, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:56:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-02b61ae2-f7e7-4fe5-9883-a1d9dbe9b2fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.437s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:56:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:56:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:56:09 user nova-compute[76049]: INFO nova.compute.manager [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Detaching volume b8128d21-fb2a-4918-acfd-481cc2da3528
Nov 15 11:56:09 user nova-compute[76049]: INFO nova.virt.block_device [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Attempting to driver detach volume b8128d21-fb2a-4918-acfd-481cc2da3528 from mountpoint /dev/vdb
Nov 15 11:56:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Attempting to detach device vdb from instance caf17d31-fac7-41bb-88c7-904561e6bb14 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:56:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:56:09 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:56:09 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:56:09 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:56:09 user nova-compute[76049]:   <serial>b8128d21-fb2a-4918-acfd-481cc2da3528</serial>
Nov 15 11:56:09 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:56:09 user nova-compute[76049]: </disk>
Nov 15 11:56:09 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:56:09 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully detached device vdb from instance caf17d31-fac7-41bb-88c7-904561e6bb14 from the persistent domain config.
Nov 15 11:56:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance caf17d31-fac7-41bb-88c7-904561e6bb14 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:56:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:56:09 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:56:09 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:56:09 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:56:09 user nova-compute[76049]:   <serial>b8128d21-fb2a-4918-acfd-481cc2da3528</serial>
Nov 15 11:56:09 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:56:09 user nova-compute[76049]: </disk>
Nov 15 11:56:09 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:56:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:56:10 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:56:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.180057525634766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance caf17d31-fac7-41bb-88c7-904561e6bb14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:56:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:56:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:15 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:20 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 11:56:20 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:22 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:25 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:56:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:56:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:56:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:56:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:30 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance caf17d31-fac7-41bb-88c7-904561e6bb14 is timed out.
Nov 15 11:56:30 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully detached device vdb from instance caf17d31-fac7-41bb-88c7-904561e6bb14 from the live domain config.
Nov 15 11:56:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCQiAMRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:56:30 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fc993f-5184-4d6d-bf6f-c9f99939d4fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:56:30 user nova-compute[76049]: No targets found.
Nov 15 11:56:30 user nova-compute[76049]: iSNS:
Nov 15 11:56:30 user nova-compute[76049]: No targets found.
Nov 15 11:56:30 user nova-compute[76049]: STATIC:
Nov 15 11:56:30 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528
Nov 15 11:56:30 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:56:30 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:56:30 user nova-compute[76049]: FIRMWARE:
Nov 15 11:56:30 user nova-compute[76049]: No targets found.
Nov 15 11:56:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:56:30 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:56:30 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[663fd3f8-a7a7-4e94-b79a-cdcf097d7a21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c78752-8f56-4ae2-af15-c7260c44fb43]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 (non-flash)
Nov 15 11:56:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 (non-flash)
Nov 15 11:56:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f629424da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca5fd4-fcfe-4b75-aeef-ac1181eeaaab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[20353fde-8ca2-4d9c-aedd-4ed688d01193]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a941a91-74c1-4915-9ec9-d072da38fe70]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02243f-6422-48da-8a4b-e7413c5f6d40]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e22769-7cd3-407e-85d8-30260e006c82]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70eaa75-68d0-4f86-8e61-a2d2ab5f869e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260]
Nov 15 11:56:30 user nova-compute[76049]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528, portal: 172.16.0.220,3260] successful.
Nov 15 11:56:30 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8128d21-fb2a-4918-acfd-481cc2da3528 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1347876e-1903-42e7-b262-135f2d2a2a64]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] <== disconnect_volume: return (284ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:56:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:56:31 user nova-compute[76049]: DEBUG nova.objects.instance [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'flavor' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:56:31 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4c8d24ad-17f2-432a-aa43-b4f537fc20a3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.593s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:56:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:35 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:45 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:56:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:56:54 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:56:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:56:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:56:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:56:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:56:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:56:55 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:56:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:57:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:57:03 user nova-compute[76049]: INFO nova.compute.manager [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] instance snapshotting
Nov 15 11:57:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Beginning live snapshot process
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json -f qcow2 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.171s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0_ninv3h/441d5b471a0546c0ab8dff5253722a83.delta 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_power_states {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:03 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0_ninv3h/441d5b471a0546c0ab8dff5253722a83.delta 1073741824" returned: 0 in 0.047s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:03 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 11:57:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 11:57:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:04 user nova-compute[76049]: INFO nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] During sync_power_state the instance has a pending task (image_pending_upload). Skip.
Nov 15 11:57:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:57:04 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] COPY block job progress, current cursor: 327680 final cursor: 75563008 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:57:05 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76049) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 11:57:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 11:57:05 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:57:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0_ninv3h/441d5b471a0546c0ab8dff5253722a83.delta /opt/stack/data/nova/instances/snapshots/tmp0_ninv3h/441d5b471a0546c0ab8dff5253722a83 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:05 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0_ninv3h/441d5b471a0546c0ab8dff5253722a83.delta /opt/stack/data/nova/instances/snapshots/tmp0_ninv3h/441d5b471a0546c0ab8dff5253722a83" returned: 0 in 0.413s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:05 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Snapshot extracted, beginning image upload
Nov 15 11:57:05 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:07 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Snapshot image upload complete
Nov 15 11:57:07 user nova-compute[76049]: INFO nova.compute.manager [None req-29d9a0c7-b32e-4a55-8709-4d3a3ab55977 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Took 4.88 seconds to snapshot the instance on the hypervisor.
Nov 15 11:57:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 11:57:09 user nova-compute[76049]: INFO nova.compute.claims [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Claim successful on node user
Nov 15 11:57:09 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 11:57:10 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 11:57:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG nova.policy [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0374d48d734a444b9bc2a710e67ca796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d66186abd51473a98eaa60ec235731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 11:57:10 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Creating image(s)
Nov 15 11:57:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "/opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "/opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "/opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "df03b31ad070476f86ce0bde0476062260eed334" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:10 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "df03b31ad070476f86ce0bde0476062260eed334" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.part --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Successfully created port: 90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.part --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.virt.images [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] 449055ab-25d8-4fc8-875d-bf247adbb913 was qcow2, converting to raw {{(pid=76049) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.privsep.utils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76049) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.part /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.converted {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.part /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.converted" returned: 0 in 0.529s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.converted --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Successfully updated port: 90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquired lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-changed-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.compute.manager [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Refreshing instance network info cache due to event network-changed-90b7c8d8-52cb-4073-a491-4a096f583809. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] Acquiring lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "df03b31ad070476f86ce0bde0476062260eed334" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.719s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:11 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334 --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "df03b31ad070476f86ce0bde0476062260eed334" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "df03b31ad070476f86ce0bde0476062260eed334" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.neutron [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updating instance_info_cache with network_info: [{"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Releasing lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Instance network_info: |[{"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] Acquired lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Refreshing network info cache for port 90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334 --force-share --output=json" returned: 0 in 0.182s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334,backing_fmt=raw /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334,backing_fmt=raw /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk 1073741824" returned: 0 in 0.149s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "df03b31ad070476f86ce0bde0476062260eed334" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334 --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df03b31ad070476f86ce0bde0476062260eed334 --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Ensure instance console log exists: /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Start _get_guest_xml network_info=[{"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bfc432043824bd65c47367c35c21284a',container_format='bare',created_at=2023-11-15T11:57:03Z,direct_url=<?>,disk_format='qcow2',id=449055ab-25d8-4fc8-875d-bf247adbb913,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1547468151',owner='3d66186abd51473a98eaa60ec235731e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T11:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '449055ab-25d8-4fc8-875d-bf247adbb913'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 11:57:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:57:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bfc432043824bd65c47367c35c21284a',container_format='bare',created_at=2023-11-15T11:57:03Z,direct_url=<?>,disk_format='qcow2',id=449055ab-25d8-4fc8-875d-bf247adbb913,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1547468151',owner='3d66186abd51473a98eaa60ec235731e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T11:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-902892225',display_name='tempest-TestStampPattern-server-902892225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-902892225',id=52,image_ref='449055ab-25d8-4fc8-875d-bf247adbb913',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy6K93O6FTQBt5mSx6WmCeWol2ftFrL4nqKzJ0Ty72ZgnuQoUGBOCS7Ht96k8KTZXbwb639733T9YE6RiKwcrs33RPkNwx7THtw8iSJnJTHCX+6s5uUB/Nz6SUWMVkAhg==',key_name='tempest-TestStampPattern-1239994036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d66186abd51473a98eaa60ec235731e',ramdisk_id='',reservation_id='r-1s6h3cpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='caf17d31-fac7-41bb-88c7-904561e6bb14',image_min_disk='1',image_min_ram='0',image_owner_id='3d66186abd51473a98eaa60ec235731e',image_owner_project_name='tempest-TestStampPattern-516077703',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-516077703-project-member',image_user_id='0374d48d734a444b9bc2a710e67ca796',network_allocated='True',owner_project_name='tempest-TestStampPattern-516077703',owner_user_name='tempest-TestStampPattern-516077703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:57:10Z,user_data=None,user_id='0374d48d734a444b9bc2a710e67ca796',uuid=71f6325a-ed30-4e06-8cfa-9436746334a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converting VIF {"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:62:6c,bridge_name='br-int',has_traffic_filtering=True,id=90b7c8d8-52cb-4073-a491-4a096f583809,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b7c8d8-52') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.objects.instance [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'pci_devices' on Instance uuid 71f6325a-ed30-4e06-8cfa-9436746334a9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updated VIF entry in instance network info cache for port 90b7c8d8-52cb-4073-a491-4a096f583809. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.neutron [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updating instance_info_cache with network_info: [{"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 11:57:12 user nova-compute[76049]:   <uuid>71f6325a-ed30-4e06-8cfa-9436746334a9</uuid>
Nov 15 11:57:12 user nova-compute[76049]:   <name>instance-00000034</name>
Nov 15 11:57:12 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 11:57:12 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 11:57:12 user nova-compute[76049]:   <metadata>
Nov 15 11:57:12 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 11:57:12 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 11:57:12 user nova-compute[76049]:       <nova:name>tempest-TestStampPattern-server-902892225</nova:name>
Nov 15 11:57:12 user nova-compute[76049]:       <nova:creationTime>2023-11-15 11:57:12</nova:creationTime>
Nov 15 11:57:12 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 11:57:12 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 11:57:12 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 11:57:12 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 11:57:12 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 11:57:12 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 11:57:12 user nova-compute[76049]:       </nova:flavor>
Nov 15 11:57:12 user nova-compute[76049]:       <nova:owner>
Nov 15 11:57:12 user nova-compute[76049]:         <nova:user uuid="0374d48d734a444b9bc2a710e67ca796">tempest-TestStampPattern-516077703-project-member</nova:user>
Nov 15 11:57:12 user nova-compute[76049]:         <nova:project uuid="3d66186abd51473a98eaa60ec235731e">tempest-TestStampPattern-516077703</nova:project>
Nov 15 11:57:12 user nova-compute[76049]:       </nova:owner>
Nov 15 11:57:12 user nova-compute[76049]:       <nova:root type="image" uuid="449055ab-25d8-4fc8-875d-bf247adbb913"/>
Nov 15 11:57:12 user nova-compute[76049]:       <nova:ports>
Nov 15 11:57:12 user nova-compute[76049]:         <nova:port uuid="90b7c8d8-52cb-4073-a491-4a096f583809">
Nov 15 11:57:12 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 11:57:12 user nova-compute[76049]:         </nova:port>
Nov 15 11:57:12 user nova-compute[76049]:       </nova:ports>
Nov 15 11:57:12 user nova-compute[76049]:     </nova:instance>
Nov 15 11:57:12 user nova-compute[76049]:   </metadata>
Nov 15 11:57:12 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 11:57:12 user nova-compute[76049]:     <system>
Nov 15 11:57:12 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 11:57:12 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 11:57:12 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 11:57:12 user nova-compute[76049]:       <entry name="serial">71f6325a-ed30-4e06-8cfa-9436746334a9</entry>
Nov 15 11:57:12 user nova-compute[76049]:       <entry name="uuid">71f6325a-ed30-4e06-8cfa-9436746334a9</entry>
Nov 15 11:57:12 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 11:57:12 user nova-compute[76049]:     </system>
Nov 15 11:57:12 user nova-compute[76049]:   </sysinfo>
Nov 15 11:57:12 user nova-compute[76049]:   <os>
Nov 15 11:57:12 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 11:57:12 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 11:57:12 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 11:57:12 user nova-compute[76049]:   </os>
Nov 15 11:57:12 user nova-compute[76049]:   <features>
Nov 15 11:57:12 user nova-compute[76049]:     <acpi/>
Nov 15 11:57:12 user nova-compute[76049]:     <apic/>
Nov 15 11:57:12 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 11:57:12 user nova-compute[76049]:   </features>
Nov 15 11:57:12 user nova-compute[76049]:   <clock offset="utc">
Nov 15 11:57:12 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 11:57:12 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 11:57:12 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 11:57:12 user nova-compute[76049]:   </clock>
Nov 15 11:57:12 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 11:57:12 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 11:57:12 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 11:57:12 user nova-compute[76049]:   </cpu>
Nov 15 11:57:12 user nova-compute[76049]:   <devices>
Nov 15 11:57:12 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 11:57:12 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 11:57:12 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk"/>
Nov 15 11:57:12 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 11:57:12 user nova-compute[76049]:     </disk>
Nov 15 11:57:12 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 11:57:12 user nova-compute[76049]:       <mac address="fa:16:3e:7f:62:6c"/>
Nov 15 11:57:12 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:57:12 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 11:57:12 user nova-compute[76049]:       <target dev="tap90b7c8d8-52"/>
Nov 15 11:57:12 user nova-compute[76049]:     </interface>
Nov 15 11:57:12 user nova-compute[76049]:     <serial type="pty">
Nov 15 11:57:12 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/console.log" append="off"/>
Nov 15 11:57:12 user nova-compute[76049]:     </serial>
Nov 15 11:57:12 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 11:57:12 user nova-compute[76049]:     <video>
Nov 15 11:57:12 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 11:57:12 user nova-compute[76049]:     </video>
Nov 15 11:57:12 user nova-compute[76049]:     <rng model="virtio">
Nov 15 11:57:12 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 11:57:12 user nova-compute[76049]:     </rng>
Nov 15 11:57:12 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 11:57:12 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 11:57:12 user nova-compute[76049]:       <stats period="10"/>
Nov 15 11:57:12 user nova-compute[76049]:     </memballoon>
Nov 15 11:57:12 user nova-compute[76049]:   </devices>
Nov 15 11:57:12 user nova-compute[76049]: </domain>
Nov 15 11:57:12 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-902892225',display_name='tempest-TestStampPattern-server-902892225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-902892225',id=52,image_ref='449055ab-25d8-4fc8-875d-bf247adbb913',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy6K93O6FTQBt5mSx6WmCeWol2ftFrL4nqKzJ0Ty72ZgnuQoUGBOCS7Ht96k8KTZXbwb639733T9YE6RiKwcrs33RPkNwx7THtw8iSJnJTHCX+6s5uUB/Nz6SUWMVkAhg==',key_name='tempest-TestStampPattern-1239994036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d66186abd51473a98eaa60ec235731e',ramdisk_id='',reservation_id='r-1s6h3cpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='caf17d31-fac7-41bb-88c7-904561e6bb14',image_min_disk='1',image_min_ram='0',image_owner_id='3d66186abd51473a98eaa60ec235731e',image_owner_project_name='tempest-TestStampPattern-516077703',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-516077703-project-member',image_user_id='0374d48d734a444b9bc2a710e67ca796',network_allocated='True',owner_project_name='tempest-TestStampPattern-516077703',owner_user_name='tempest-TestStampPattern-516077703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T11:57:10Z,user_data=None,user_id='0374d48d734a444b9bc2a710e67ca796',uuid=71f6325a-ed30-4e06-8cfa-9436746334a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converting VIF {"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:62:6c,bridge_name='br-int',has_traffic_filtering=True,id=90b7c8d8-52cb-4073-a491-4a096f583809,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b7c8d8-52') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG os_vif [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:62:6c,bridge_name='br-int',has_traffic_filtering=True,id=90b7c8d8-52cb-4073-a491-4a096f583809,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b7c8d8-52') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27ab8320-09b9-5d82-9251-9e72e9933387', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-86b80593-db7b-471c-83d3-884ff14b43c2 req-9423d96f-f4a8-425c-b11a-990a231f81ba service nova] Releasing lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90b7c8d8-52, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90b7c8d8-52, col_values=(('qos', UUID('ba9e843f-88a3-4824-b34d-1ea68f9f3661')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90b7c8d8-52, col_values=(('external_ids', {'iface-id': '90b7c8d8-52cb-4073-a491-4a096f583809', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:62:6c', 'vm-uuid': '71f6325a-ed30-4e06-8cfa-9436746334a9'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:12 user nova-compute[76049]: INFO os_vif [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:62:6c,bridge_name='br-int',has_traffic_filtering=True,id=90b7c8d8-52cb-4073-a491-4a096f583809,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b7c8d8-52')
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:57:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No VIF found with MAC fa:16:3e:7f:62:6c, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:57:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:13 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:57:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-14150524-dbaa-4b56-ab59-6a7d5a13ab99 req-840ea857-7dee-4566-904a-695e4437bfb6 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14150524-dbaa-4b56-ab59-6a7d5a13ab99 req-840ea857-7dee-4566-904a-695e4437bfb6 service nova] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14150524-dbaa-4b56-ab59-6a7d5a13ab99 req-840ea857-7dee-4566-904a-695e4437bfb6 service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-14150524-dbaa-4b56-ab59-6a7d5a13ab99 req-840ea857-7dee-4566-904a-695e4437bfb6 service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG nova.compute.manager [req-14150524-dbaa-4b56-ab59-6a7d5a13ab99 req-840ea857-7dee-4566-904a-695e4437bfb6 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] No waiting events found dispatching network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:57:14 user nova-compute[76049]: WARNING nova.compute.manager [req-14150524-dbaa-4b56-ab59-6a7d5a13ab99 req-840ea857-7dee-4566-904a-695e4437bfb6 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received unexpected event network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 for instance with vm_state building and task_state spawning.
Nov 15 11:57:14 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:57:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-bfc1afcd-0deb-43c8-8de9-de99b806267e req-fc2984ca-f3cc-46a3-8095-1f4c22015cde service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bfc1afcd-0deb-43c8-8de9-de99b806267e req-fc2984ca-f3cc-46a3-8095-1f4c22015cde service nova] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bfc1afcd-0deb-43c8-8de9-de99b806267e req-fc2984ca-f3cc-46a3-8095-1f4c22015cde service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-bfc1afcd-0deb-43c8-8de9-de99b806267e req-fc2984ca-f3cc-46a3-8095-1f4c22015cde service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.manager [req-bfc1afcd-0deb-43c8-8de9-de99b806267e req-fc2984ca-f3cc-46a3-8095-1f4c22015cde service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] No waiting events found dispatching network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 11:57:16 user nova-compute[76049]: WARNING nova.compute.manager [req-bfc1afcd-0deb-43c8-8de9-de99b806267e req-fc2984ca-f3cc-46a3-8095-1f4c22015cde service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received unexpected event network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 for instance with vm_state building and task_state spawning.
Nov 15 11:57:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:57:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.035507202148438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:57:16 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Instance spawned successfully.
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance caf17d31-fac7-41bb-88c7-904561e6bb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 71f6325a-ed30-4e06-8cfa-9436746334a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:57:16 user nova-compute[76049]: INFO nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 11:57:16 user nova-compute[76049]: INFO nova.compute.manager [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Took 6.82 seconds to build instance.
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-e2bac19c-93a4-46c1-baa0-c7ca8269f842 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.913s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:57:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:57:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:57:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:57:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:57:58 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:57:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:57:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:57:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:57:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:58:05 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:58:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:58:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:58:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:58:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:58:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:58:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:58:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:58:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=25.033306121826172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance caf17d31-fac7-41bb-88c7-904561e6bb14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 71f6325a-ed30-4e06-8cfa-9436746334a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:58:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:58:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:58:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:26 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updating instance_info_cache with network_info: [{"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:58:56 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:58:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:59:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:00 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-changed-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 11:59:01 user nova-compute[76049]: DEBUG nova.compute.manager [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Refreshing instance network info cache due to event network-changed-90b7c8d8-52cb-4073-a491-4a096f583809. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 11:59:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] Acquiring lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:59:01 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] Acquired lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:59:01 user nova-compute[76049]: DEBUG nova.network.neutron [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Refreshing network info cache for port 90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updated VIF entry in instance network info cache for port 90b7c8d8-52cb-4073-a491-4a096f583809. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updating instance_info_cache with network_info: [{"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b0dfba88-1306-41a0-8cfa-a8a2652e26c7 req-9f94fede-e7c8-41b0-afaa-676091a91563 service nova] Releasing lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'flavor' on Instance uuid 71f6325a-ed30-4e06-8cfa-9436746334a9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:59:02 user nova-compute[76049]: INFO nova.compute.manager [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Attaching volume 33463845-d8f0-4d3f-9b71-b1c10033aa84 to /dev/vdb
Nov 15 11:59:02 user nova-compute[76049]: DEBUG os_brick.utils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0275d9f9-7105-44a3-b32b-a2ae438d7cf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e0c12-b0aa-46a2-bca7-c34cc357e464]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82c9d61-5886-4930-8792-06ae653a0c21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2b04be-d9d7-4916-908f-892cac4a8a13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 11:59:02 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 11:59:02 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f080553-f7c2-433d-a6b0-f7d45377069d]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG os_brick.utils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updating existing volume attachment record: 20be0161-8ec2-4898-b036-f21349fa822f {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 11:59:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:05 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkYMjJmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:59:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:59:07 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:59:07 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e0f4e9-af69-42c3-9d44-9e0c3f576e4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 11:59:07 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0103da1b-e5f8-4668-996f-565b52eb1e8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84] added
Nov 15 11:59:07 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bec56c-6e11-4a1d-a86c-0f572f4936a9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:07 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f7172-89de-43c0-9d3d-ac37a85158dd]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkYMjJmd {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkYMjJmd" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e663fbe0-e1dd-44f4-aa3e-774514b385bd]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xkYMjJmd'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f785d185-9416-4697-a227-11771882cbc8]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f20606-fcd3-4269-9ba1-6b5f5d15fe37]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:59:08 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 11:59:08 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:59:08 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 11:59:08 user nova-compute[76049]: 
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d4cbeb-8c74-4186-b482-033dc2e32aa7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260]
Nov 15 11:59:08 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260] successful.
Nov 15 11:59:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e521d0-b2d0-4944-a553-1cf15137c1c3]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f1c21-8d74-4cf6-843e-0f742a9777e5]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 (non-flash)
Nov 15 11:59:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 (non-flash)
Nov 15 11:59:08 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f93910-f03c-4b74-8917-c1ce186654b4]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkYMjJmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 11:59:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26236386138636137', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236386138636137', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG nova.objects.instance [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'flavor' on Instance uuid 71f6325a-ed30-4e06-8cfa-9436746334a9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 11:59:09 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:59:09 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:59:09 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:59:09 user nova-compute[76049]:   <serial>33463845-d8f0-4d3f-9b71-b1c10033aa84</serial>
Nov 15 11:59:09 user nova-compute[76049]: </disk>
Nov 15 11:59:09 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] No VIF found with MAC fa:16:3e:7f:62:6c, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 11:59:09 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-b6a5a29b-9f26-4dbd-9681-837ae67118c3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.462s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:59:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:59:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:59:11 user nova-compute[76049]: INFO nova.compute.manager [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Detaching volume 33463845-d8f0-4d3f-9b71-b1c10033aa84
Nov 15 11:59:11 user nova-compute[76049]: INFO nova.virt.block_device [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Attempting to driver detach volume 33463845-d8f0-4d3f-9b71-b1c10033aa84 from mountpoint /dev/vdb
Nov 15 11:59:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Attempting to detach device vdb from instance 71f6325a-ed30-4e06-8cfa-9436746334a9 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 11:59:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:59:11 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:59:11 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:59:11 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:59:11 user nova-compute[76049]:   <serial>33463845-d8f0-4d3f-9b71-b1c10033aa84</serial>
Nov 15 11:59:11 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:59:11 user nova-compute[76049]: </disk>
Nov 15 11:59:11 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:59:11 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully detached device vdb from instance 71f6325a-ed30-4e06-8cfa-9436746334a9 from the persistent domain config.
Nov 15 11:59:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71f6325a-ed30-4e06-8cfa-9436746334a9 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 11:59:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 11:59:11 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 11:59:11 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 11:59:11 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 11:59:11 user nova-compute[76049]:   <serial>33463845-d8f0-4d3f-9b71-b1c10033aa84</serial>
Nov 15 11:59:11 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 11:59:11 user nova-compute[76049]: </disk>
Nov 15 11:59:11 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 11:59:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71f6325a-ed30-4e06-8cfa-9436746334a9 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 11:59:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:59:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.032268524169922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance caf17d31-fac7-41bb-88c7-904561e6bb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance 71f6325a-ed30-4e06-8cfa-9436746334a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 11:59:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:59:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:31 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71f6325a-ed30-4e06-8cfa-9436746334a9 is timed out.
Nov 15 11:59:31 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully detached device vdb from instance 71f6325a-ed30-4e06-8cfa-9436746334a9 from the live domain config.
Nov 15 11:59:31 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkYMjJmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 11:59:31 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc36600-434c-4082-892c-5efdfd8d931f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 11:59:31 user nova-compute[76049]: No targets found.
Nov 15 11:59:31 user nova-compute[76049]: iSNS:
Nov 15 11:59:31 user nova-compute[76049]: No targets found.
Nov 15 11:59:31 user nova-compute[76049]: STATIC:
Nov 15 11:59:31 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84
Nov 15 11:59:31 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 11:59:31 user nova-compute[76049]:                 Iface Name: default
Nov 15 11:59:31 user nova-compute[76049]: FIRMWARE:
Nov 15 11:59:31 user nova-compute[76049]: No targets found.
Nov 15 11:59:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 11:59:31 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 11:59:31 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d4736-3b3e-47cf-84bd-2b14ab024dea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1809b1-fa3b-4b9a-bcf1-bba47936d7f8]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 (non-flash)
Nov 15 11:59:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 (non-flash)
Nov 15 11:59:31 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62842931c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca1f860-c06e-4cea-8a1e-5c4c2aed02f9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6fafd4-cce4-409c-81c5-2e68d809bc62]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ff731-9788-4b1d-b96e-14c780f22ecb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b34faad-bc33-4548-b4e3-9cc823f42f26]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[604cb097-c690-454c-a01b-46b425daaa81]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:31 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfe8a9e-9cb6-426f-a08f-309a39972f0e]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260]
Nov 15 11:59:32 user nova-compute[76049]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84, portal: 172.16.0.220,3260] successful.
Nov 15 11:59:32 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33463845-d8f0-4d3f-9b71-b1c10033aa84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[875c28fc-0dfe-4059-a594-e3e623e19036]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] <== disconnect_volume: return (271ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG nova.objects.instance [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'flavor' on Instance uuid 71f6325a-ed30-4e06-8cfa-9436746334a9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-3daac8fd-1da6-45df-8913-bedff627f3fa tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 11:59:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 11:59:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 11:59:57 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 11:59:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 11:59:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 11:59:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:01 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-changed-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Refreshing instance network info cache due to event network-changed-90b7c8d8-52cb-4073-a491-4a096f583809. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] Acquiring lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] Acquired lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Refreshing network info cache for port 90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:02 user nova-compute[76049]: INFO nova.compute.manager [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Terminating instance
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updated VIF entry in instance network info cache for port 90b7c8d8-52cb-4073-a491-4a096f583809. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.network.neutron [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updating instance_info_cache with network_info: [{"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6bf59f6b-297d-4a0e-8e07-7706d08a91b7 req-ea25f742-5091-4801-88d8-7a7531df6dbb service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-vif-unplugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6bf59f6b-297d-4a0e-8e07-7706d08a91b7 req-ea25f742-5091-4801-88d8-7a7531df6dbb service nova] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6bf59f6b-297d-4a0e-8e07-7706d08a91b7 req-ea25f742-5091-4801-88d8-7a7531df6dbb service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6bf59f6b-297d-4a0e-8e07-7706d08a91b7 req-ea25f742-5091-4801-88d8-7a7531df6dbb service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6bf59f6b-297d-4a0e-8e07-7706d08a91b7 req-ea25f742-5091-4801-88d8-7a7531df6dbb service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] No waiting events found dispatching network-vif-unplugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.compute.manager [req-6bf59f6b-297d-4a0e-8e07-7706d08a91b7 req-ea25f742-5091-4801-88d8-7a7531df6dbb service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-vif-unplugged-90b7c8d8-52cb-4073-a491-4a096f583809 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-6b3e538b-d9f8-4d66-90fc-8faaac262ac6 req-4241db12-fc87-44e5-a504-731e5aa5b486 service nova] Releasing lock "refresh_cache-71f6325a-ed30-4e06-8cfa-9436746334a9" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Instance destroyed successfully.
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'resources' on Instance uuid 71f6325a-ed30-4e06-8cfa-9436746334a9 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-902892225',display_name='tempest-TestStampPattern-server-902892225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-902892225',id=52,image_ref='449055ab-25d8-4fc8-875d-bf247adbb913',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy6K93O6FTQBt5mSx6WmCeWol2ftFrL4nqKzJ0Ty72ZgnuQoUGBOCS7Ht96k8KTZXbwb639733T9YE6RiKwcrs33RPkNwx7THtw8iSJnJTHCX+6s5uUB/Nz6SUWMVkAhg==',key_name='tempest-TestStampPattern-1239994036',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:57:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d66186abd51473a98eaa60ec235731e',ramdisk_id='',reservation_id='r-1s6h3cpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='caf17d31-fac7-41bb-88c7-904561e6bb14',image_min_disk='1',image_min_ram='0',image_owner_id='3d66186abd51473a98eaa60ec235731e',image_owner_project_name='tempest-TestStampPattern-516077703',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-516077703-project-member',image_user_id='0374d48d734a444b9bc2a710e67ca796',owner_project_name='tempest-TestStampPattern-516077703',owner_user_name='tempest-TestStampPattern-516077703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:57:17Z,user_data=None,user_id='0374d48d734a444b9bc2a710e67ca796',uuid=71f6325a-ed30-4e06-8cfa-9436746334a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converting VIF {"id": "90b7c8d8-52cb-4073-a491-4a096f583809", "address": "fa:16:3e:7f:62:6c", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b7c8d8-52", "ovs_interfaceid": "90b7c8d8-52cb-4073-a491-4a096f583809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:62:6c,bridge_name='br-int',has_traffic_filtering=True,id=90b7c8d8-52cb-4073-a491-4a096f583809,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b7c8d8-52') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG os_vif [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:62:6c,bridge_name='br-int',has_traffic_filtering=True,id=90b7c8d8-52cb-4073-a491-4a096f583809,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b7c8d8-52') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90b7c8d8-52, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba9e843f-88a3-4824-b34d-1ea68f9f3661) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:00:02 user nova-compute[76049]: INFO os_vif [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:62:6c,bridge_name='br-int',has_traffic_filtering=True,id=90b7c8d8-52cb-4073-a491-4a096f583809,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b7c8d8-52')
Nov 15 12:00:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Deleting instance files /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9_del
Nov 15 12:00:02 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Deletion of /opt/stack/data/nova/instances/71f6325a-ed30-4e06-8cfa-9436746334a9_del complete
Nov 15 12:00:02 user nova-compute[76049]: INFO nova.compute.manager [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 12:00:02 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:00:02 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:00:03 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:00:03 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Took 0.46 seconds to deallocate network for instance.
Nov 15 12:00:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:03 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:00:03 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:00:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:03 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Deleted allocations for instance 71f6325a-ed30-4e06-8cfa-9436746334a9
Nov 15 12:00:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4029f99a-c1a1-4bfe-a8ab-a44095789bf3 tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-c93b6d86-2e59-4f4a-aa6c-fe1b0e7c73bf req-7c778773-bb24-4d2d-b7c2-8a6b07bd1884 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-vif-deleted-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:00:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-9e810904-69fb-485b-9114-0621796b5848 req-c8548be5-62f9-44cb-b470-e6b561354026 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received event network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:00:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9e810904-69fb-485b-9114-0621796b5848 req-c8548be5-62f9-44cb-b470-e6b561354026 service nova] Acquiring lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9e810904-69fb-485b-9114-0621796b5848 req-c8548be5-62f9-44cb-b470-e6b561354026 service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9e810904-69fb-485b-9114-0621796b5848 req-c8548be5-62f9-44cb-b470-e6b561354026 service nova] Lock "71f6325a-ed30-4e06-8cfa-9436746334a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:04 user nova-compute[76049]: DEBUG nova.compute.manager [req-9e810904-69fb-485b-9114-0621796b5848 req-c8548be5-62f9-44cb-b470-e6b561354026 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] No waiting events found dispatching network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:00:04 user nova-compute[76049]: WARNING nova.compute.manager [req-9e810904-69fb-485b-9114-0621796b5848 req-c8548be5-62f9-44cb-b470-e6b561354026 service nova] [instance: 71f6325a-ed30-4e06-8cfa-9436746334a9] Received unexpected event network-vif-plugged-90b7c8d8-52cb-4073-a491-4a096f583809 for instance with vm_state deleted and task_state None.
Nov 15 12:00:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:00:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:00:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:00:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:00:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:00:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:00:15 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:00:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:00:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:00:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.03276824951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance caf17d31-fac7-41bb-88c7-904561e6bb14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:00:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:00:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:29 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:00:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:00:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:00:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:00:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-changed-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Refreshing instance network info cache due to event network-changed-c02b3756-d520-426a-9cc9-1b9f5b7480a3. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] Acquiring lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] Acquired lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG nova.network.neutron [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Refreshing network info cache for port c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:57 user nova-compute[76049]: INFO nova.compute.manager [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Terminating instance
Nov 15 12:00:57 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.network.neutron [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updated VIF entry in instance network info cache for port c02b3756-d520-426a-9cc9-1b9f5b7480a3. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.network.neutron [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [{"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-9b68303e-f2e1-4226-992e-e0c2c2c27553 req-0d02eb81-1254-4377-8b2e-4f04d9005000 service nova] Releasing lock "refresh_cache-caf17d31-fac7-41bb-88c7-904561e6bb14" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-553ebb80-d6ee-45e3-a0ed-140ef1fb898b req-acc6797a-0019-47cd-81c4-ba28fc1453dd service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-vif-unplugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-553ebb80-d6ee-45e3-a0ed-140ef1fb898b req-acc6797a-0019-47cd-81c4-ba28fc1453dd service nova] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-553ebb80-d6ee-45e3-a0ed-140ef1fb898b req-acc6797a-0019-47cd-81c4-ba28fc1453dd service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-553ebb80-d6ee-45e3-a0ed-140ef1fb898b req-acc6797a-0019-47cd-81c4-ba28fc1453dd service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-553ebb80-d6ee-45e3-a0ed-140ef1fb898b req-acc6797a-0019-47cd-81c4-ba28fc1453dd service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] No waiting events found dispatching network-vif-unplugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-553ebb80-d6ee-45e3-a0ed-140ef1fb898b req-acc6797a-0019-47cd-81c4-ba28fc1453dd service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-vif-unplugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:00:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Instance destroyed successfully.
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lazy-loading 'resources' on Instance uuid caf17d31-fac7-41bb-88c7-904561e6bb14 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T11:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1077786327',display_name='tempest-TestStampPattern-server-1077786327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1077786327',id=51,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy6K93O6FTQBt5mSx6WmCeWol2ftFrL4nqKzJ0Ty72ZgnuQoUGBOCS7Ht96k8KTZXbwb639733T9YE6RiKwcrs33RPkNwx7THtw8iSJnJTHCX+6s5uUB/Nz6SUWMVkAhg==',key_name='tempest-TestStampPattern-1239994036',keypairs=<?>,launch_index=0,launched_at=2023-11-15T11:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d66186abd51473a98eaa60ec235731e',ramdisk_id='',reservation_id='r-rsurfmw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-516077703',owner_user_name='tempest-TestStampPattern-516077703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T11:57:08Z,user_data=None,user_id='0374d48d734a444b9bc2a710e67ca796',uuid=caf17d31-fac7-41bb-88c7-904561e6bb14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converting VIF {"id": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "address": "fa:16:3e:92:9d:d6", "network": {"id": "50bae268-c740-4bf4-adb6-77233e34b13d", "bridge": "br-int", "label": "tempest-TestStampPattern-71633732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d66186abd51473a98eaa60ec235731e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02b3756-d5", "ovs_interfaceid": "c02b3756-d520-426a-9cc9-1b9f5b7480a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=c02b3756-d520-426a-9cc9-1b9f5b7480a3,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02b3756-d5') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG os_vif [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=c02b3756-d520-426a-9cc9-1b9f5b7480a3,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02b3756-d5') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc02b3756-d5, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28c91d79-1919-4921-ae8c-631ac322c32c) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:00:58 user nova-compute[76049]: INFO os_vif [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=c02b3756-d520-426a-9cc9-1b9f5b7480a3,network=Network(50bae268-c740-4bf4-adb6-77233e34b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02b3756-d5')
Nov 15 12:00:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Deleting instance files /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14_del
Nov 15 12:00:58 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Deletion of /opt/stack/data/nova/instances/caf17d31-fac7-41bb-88c7-904561e6bb14_del complete
Nov 15 12:00:58 user nova-compute[76049]: INFO nova.compute.manager [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 12:00:58 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:00:58 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:00:59 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:00:59 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Took 0.42 seconds to deallocate network for instance.
Nov 15 12:00:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:00:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:00:59 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:00:59 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:00:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:59 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Deleted allocations for instance caf17d31-fac7-41bb-88c7-904561e6bb14
Nov 15 12:00:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce6012ce-0628-416e-a99c-a46be3f3d18c tempest-TestStampPattern-516077703 tempest-TestStampPattern-516077703-project-member] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.579s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:00:59 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:00:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-1a9b559a-1230-42ca-9275-b0978a4d0b1a req-5b45b0f4-17a7-4a5f-8560-0edaa900cb96 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-vif-deleted-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:01:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-135298d2-c3ab-440e-8edf-533116bbddfd req-5a037ff4-f50f-4a13-ad83-394078521a30 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received event network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:01:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-135298d2-c3ab-440e-8edf-533116bbddfd req-5a037ff4-f50f-4a13-ad83-394078521a30 service nova] Acquiring lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:01:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-135298d2-c3ab-440e-8edf-533116bbddfd req-5a037ff4-f50f-4a13-ad83-394078521a30 service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:01:00 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-135298d2-c3ab-440e-8edf-533116bbddfd req-5a037ff4-f50f-4a13-ad83-394078521a30 service nova] Lock "caf17d31-fac7-41bb-88c7-904561e6bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:01:00 user nova-compute[76049]: DEBUG nova.compute.manager [req-135298d2-c3ab-440e-8edf-533116bbddfd req-5a037ff4-f50f-4a13-ad83-394078521a30 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] No waiting events found dispatching network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:01:00 user nova-compute[76049]: WARNING nova.compute.manager [req-135298d2-c3ab-440e-8edf-533116bbddfd req-5a037ff4-f50f-4a13-ad83-394078521a30 service nova] [instance: caf17d31-fac7-41bb-88c7-904561e6bb14] Received unexpected event network-vif-plugged-c02b3756-d520-426a-9cc9-1b9f5b7480a3 for instance with vm_state deleted and task_state None.
Nov 15 12:01:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:08 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:01:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:10 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:01:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:01:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:01:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:01:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:01:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:01:16 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:01:16 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=25.15747833251953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:01:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:01:16 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 12:01:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 12:01:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:01:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:01:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:01:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:01:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:31 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 12:01:31 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:01:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:01:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:01:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:01:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:01:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:01:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:01:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:01:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:01:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:02:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:02:00 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:02:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:11 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:02:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:02:18 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:02:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=25.155033111572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:02:18 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:02:19 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:02:19 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:02:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:23 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:25 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:28 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:30 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:32 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:02:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Starting instance... {{(pid=76049) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76049) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:02:38 user nova-compute[76049]: INFO nova.compute.claims [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Claim successful on node user
Nov 15 12:02:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Start building networks asynchronously for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Allocating IP information in the background. {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.network.neutron [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] allocate_for_instance() {{(pid=76049) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:02:38 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Start building block device mappings for instance. {{(pid=76049) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:38 user nova-compute[76049]: DEBUG nova.policy [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c79aa3da66e4d539a58210aac582212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c3ccb20e3e4b45b152ef41ba57081d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76049) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Start spawning the instance on the hypervisor. {{(pid=76049) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Creating instance directory {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:02:39 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Creating image(s)
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "/opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "/opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.179s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.177s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk 1073741824 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc,backing_fmt=raw /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk 1073741824" returned: 0 in 0.059s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "ad486dc4e3d31affc829c29a1071ff49e55344dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad486dc4e3d31affc829c29a1071ff49e55344dc --force-share --output=json" returned: 0 in 0.205s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk. size=1073741824 {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG nova.virt.disk.api [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Cannot resize image /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk to a smaller size. {{(pid=76049) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Created local disks {{(pid=76049) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Ensure instance console log exists: /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/console.log {{(pid=76049) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:39 user nova-compute[76049]: DEBUG nova.network.neutron [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Successfully created port: 0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Successfully updated port: 0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Building network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-changed-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.compute.manager [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Refreshing instance network info cache due to event network-changed-0e142fb4-2a23-4ee1-ab03-988afb5e5336. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Instance cache missing network info. {{(pid=76049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.neutron [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Instance network_info: |[{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76049) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.neutron [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Refreshing network info cache for port 0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Start _get_guest_xml network_info=[{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'image_id': '2b3c94d7-0d98-4e44-a0fb-491b41156c7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:02:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:02:40 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CPU controller missing on host. {{(pid=76049) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.host [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CPU controller found on host. {{(pid=76049) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76049) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T11:05:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T11:05:38Z,direct_url=<?>,disk_format='qcow2',id=2b3c94d7-0d98-4e44-a0fb-491b41156c7f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85ce1f2d692f4b71b461029ac1dfdbbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T11:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Flavor limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Image limits 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Flavor pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Image pref 0:0:0 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Got 1 possible topologies {{(pid=76049) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.hardware [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76049) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1492800346',display_name='tempest-SnapshotDataIntegrityTests-server-1492800346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1492800346',id=53,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9VDSuYtSiSr10ovxAnGLKZpszlIe68JiQunUk6qzxk5RuAPwje3q+xc5ViO152kzLGusOMWE5hUdi5ciX5f9xPFgikKHhAQzyOeucM8RQ3H+6yVWrpl6WEg1LwHEebdw==',key_name='tempest-keypair-2023013062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78c3ccb20e3e4b45b152ef41ba57081d',ramdisk_id='',reservation_id='r-8rn4zgjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1875141519',owner_user_name='tempest-SnapshotDataIntegrityTests-1875141519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c79aa3da66e4d539a58210aac582212',uuid=c9945de1-42a3-418f-8641-c0fc3ec29d60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76049) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Converting VIF {"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f0:30,bridge_name='br-int',has_traffic_filtering=True,id=0e142fb4-2a23-4ee1-ab03-988afb5e5336,network=Network(a50b18e0-c332-45f6-8491-3cc64e6cbfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e142fb4-2a') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.objects.instance [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'pci_devices' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:02:40 user nova-compute[76049]:   <uuid>c9945de1-42a3-418f-8641-c0fc3ec29d60</uuid>
Nov 15 12:02:40 user nova-compute[76049]:   <name>instance-00000035</name>
Nov 15 12:02:40 user nova-compute[76049]:   <memory>524288</memory>
Nov 15 12:02:40 user nova-compute[76049]:   <vcpu>1</vcpu>
Nov 15 12:02:40 user nova-compute[76049]:   <metadata>
Nov 15 12:02:40 user nova-compute[76049]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:02:40 user nova-compute[76049]:       <nova:package version="0.0.0"/>
Nov 15 12:02:40 user nova-compute[76049]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1492800346</nova:name>
Nov 15 12:02:40 user nova-compute[76049]:       <nova:creationTime>2023-11-15 12:02:40</nova:creationTime>
Nov 15 12:02:40 user nova-compute[76049]:       <nova:flavor name="m1.tiny">
Nov 15 12:02:40 user nova-compute[76049]:         <nova:memory>512</nova:memory>
Nov 15 12:02:40 user nova-compute[76049]:         <nova:disk>1</nova:disk>
Nov 15 12:02:40 user nova-compute[76049]:         <nova:swap>0</nova:swap>
Nov 15 12:02:40 user nova-compute[76049]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:02:40 user nova-compute[76049]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:02:40 user nova-compute[76049]:       </nova:flavor>
Nov 15 12:02:40 user nova-compute[76049]:       <nova:owner>
Nov 15 12:02:40 user nova-compute[76049]:         <nova:user uuid="8c79aa3da66e4d539a58210aac582212">tempest-SnapshotDataIntegrityTests-1875141519-project-member</nova:user>
Nov 15 12:02:40 user nova-compute[76049]:         <nova:project uuid="78c3ccb20e3e4b45b152ef41ba57081d">tempest-SnapshotDataIntegrityTests-1875141519</nova:project>
Nov 15 12:02:40 user nova-compute[76049]:       </nova:owner>
Nov 15 12:02:40 user nova-compute[76049]:       <nova:root type="image" uuid="2b3c94d7-0d98-4e44-a0fb-491b41156c7f"/>
Nov 15 12:02:40 user nova-compute[76049]:       <nova:ports>
Nov 15 12:02:40 user nova-compute[76049]:         <nova:port uuid="0e142fb4-2a23-4ee1-ab03-988afb5e5336">
Nov 15 12:02:40 user nova-compute[76049]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 12:02:40 user nova-compute[76049]:         </nova:port>
Nov 15 12:02:40 user nova-compute[76049]:       </nova:ports>
Nov 15 12:02:40 user nova-compute[76049]:     </nova:instance>
Nov 15 12:02:40 user nova-compute[76049]:   </metadata>
Nov 15 12:02:40 user nova-compute[76049]:   <sysinfo type="smbios">
Nov 15 12:02:40 user nova-compute[76049]:     <system>
Nov 15 12:02:40 user nova-compute[76049]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:02:40 user nova-compute[76049]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:02:40 user nova-compute[76049]:       <entry name="version">0.0.0</entry>
Nov 15 12:02:40 user nova-compute[76049]:       <entry name="serial">c9945de1-42a3-418f-8641-c0fc3ec29d60</entry>
Nov 15 12:02:40 user nova-compute[76049]:       <entry name="uuid">c9945de1-42a3-418f-8641-c0fc3ec29d60</entry>
Nov 15 12:02:40 user nova-compute[76049]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:02:40 user nova-compute[76049]:     </system>
Nov 15 12:02:40 user nova-compute[76049]:   </sysinfo>
Nov 15 12:02:40 user nova-compute[76049]:   <os>
Nov 15 12:02:40 user nova-compute[76049]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:02:40 user nova-compute[76049]:     <boot dev="hd"/>
Nov 15 12:02:40 user nova-compute[76049]:     <smbios mode="sysinfo"/>
Nov 15 12:02:40 user nova-compute[76049]:   </os>
Nov 15 12:02:40 user nova-compute[76049]:   <features>
Nov 15 12:02:40 user nova-compute[76049]:     <acpi/>
Nov 15 12:02:40 user nova-compute[76049]:     <apic/>
Nov 15 12:02:40 user nova-compute[76049]:     <vmcoreinfo/>
Nov 15 12:02:40 user nova-compute[76049]:   </features>
Nov 15 12:02:40 user nova-compute[76049]:   <clock offset="utc">
Nov 15 12:02:40 user nova-compute[76049]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:02:40 user nova-compute[76049]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:02:40 user nova-compute[76049]:     <timer name="hpet" present="no"/>
Nov 15 12:02:40 user nova-compute[76049]:   </clock>
Nov 15 12:02:40 user nova-compute[76049]:   <cpu mode="custom" match="exact">
Nov 15 12:02:40 user nova-compute[76049]:     <model>Nehalem</model>
Nov 15 12:02:40 user nova-compute[76049]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:02:40 user nova-compute[76049]:   </cpu>
Nov 15 12:02:40 user nova-compute[76049]:   <devices>
Nov 15 12:02:40 user nova-compute[76049]:     <disk type="file" device="disk">
Nov 15 12:02:40 user nova-compute[76049]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:02:40 user nova-compute[76049]:       <source file="/opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk"/>
Nov 15 12:02:40 user nova-compute[76049]:       <target dev="vda" bus="virtio"/>
Nov 15 12:02:40 user nova-compute[76049]:     </disk>
Nov 15 12:02:40 user nova-compute[76049]:     <interface type="ethernet">
Nov 15 12:02:40 user nova-compute[76049]:       <mac address="fa:16:3e:9e:f0:30"/>
Nov 15 12:02:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 12:02:40 user nova-compute[76049]:       <mtu size="1442"/>
Nov 15 12:02:40 user nova-compute[76049]:       <target dev="tap0e142fb4-2a"/>
Nov 15 12:02:40 user nova-compute[76049]:     </interface>
Nov 15 12:02:40 user nova-compute[76049]:     <serial type="pty">
Nov 15 12:02:40 user nova-compute[76049]:       <log file="/opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/console.log" append="off"/>
Nov 15 12:02:40 user nova-compute[76049]:     </serial>
Nov 15 12:02:40 user nova-compute[76049]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:02:40 user nova-compute[76049]:     <video>
Nov 15 12:02:40 user nova-compute[76049]:       <model type="virtio"/>
Nov 15 12:02:40 user nova-compute[76049]:     </video>
Nov 15 12:02:40 user nova-compute[76049]:     <rng model="virtio">
Nov 15 12:02:40 user nova-compute[76049]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:02:40 user nova-compute[76049]:     </rng>
Nov 15 12:02:40 user nova-compute[76049]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:02:40 user nova-compute[76049]:     <memballoon model="virtio">
Nov 15 12:02:40 user nova-compute[76049]:       <stats period="10"/>
Nov 15 12:02:40 user nova-compute[76049]:     </memballoon>
Nov 15 12:02:40 user nova-compute[76049]:   </devices>
Nov 15 12:02:40 user nova-compute[76049]: </domain>
Nov 15 12:02:40 user nova-compute[76049]:  {{(pid=76049) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1492800346',display_name='tempest-SnapshotDataIntegrityTests-server-1492800346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1492800346',id=53,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9VDSuYtSiSr10ovxAnGLKZpszlIe68JiQunUk6qzxk5RuAPwje3q+xc5ViO152kzLGusOMWE5hUdi5ciX5f9xPFgikKHhAQzyOeucM8RQ3H+6yVWrpl6WEg1LwHEebdw==',key_name='tempest-keypair-2023013062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78c3ccb20e3e4b45b152ef41ba57081d',ramdisk_id='',reservation_id='r-8rn4zgjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1875141519',owner_user_name='tempest-SnapshotDataIntegrityTests-1875141519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c79aa3da66e4d539a58210aac582212',uuid=c9945de1-42a3-418f-8641-c0fc3ec29d60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Converting VIF {"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f0:30,bridge_name='br-int',has_traffic_filtering=True,id=0e142fb4-2a23-4ee1-ab03-988afb5e5336,network=Network(a50b18e0-c332-45f6-8491-3cc64e6cbfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e142fb4-2a') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG os_vif [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f0:30,bridge_name='br-int',has_traffic_filtering=True,id=0e142fb4-2a23-4ee1-ab03-988afb5e5336,network=Network(a50b18e0-c332-45f6-8491-3cc64e6cbfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e142fb4-2a') {{(pid=76049) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c1e0161-3c5d-53d5-ab2a-47cd03bf019c', '_type': 'linux-noop'}}, row=False) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:02:40 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e142fb4-2a, may_exist=True, interface_attrs={}) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e142fb4-2a, col_values=(('qos', UUID('7f067001-7fb9-4454-a69c-38b8d9e2aff6')),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e142fb4-2a, col_values=(('external_ids', {'iface-id': '0e142fb4-2a23-4ee1-ab03-988afb5e5336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:f0:30', 'vm-uuid': 'c9945de1-42a3-418f-8641-c0fc3ec29d60'}),), if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:41 user nova-compute[76049]: INFO os_vif [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f0:30,bridge_name='br-int',has_traffic_filtering=True,id=0e142fb4-2a23-4ee1-ab03-988afb5e5336,network=Network(a50b18e0-c332-45f6-8491-3cc64e6cbfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e142fb4-2a')
Nov 15 12:02:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No VIF found with MAC fa:16:3e:9e:f0:30, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated VIF entry in instance network info cache for port 0e142fb4-2a23-4ee1-ab03-988afb5e5336. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG nova.network.neutron [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:02:41 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8e07b423-4a0f-47c8-a22f-b0f996d0e49a req-84a66cca-20fa-40ee-b656-8e1f104fd647 service nova] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:02:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-7c569837-ab39-49fd-ab46-448f90463c8a req-b361fcf2-fc78-4a10-a90a-b3e35c8e253e service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:02:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7c569837-ab39-49fd-ab46-448f90463c8a req-b361fcf2-fc78-4a10-a90a-b3e35c8e253e service nova] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7c569837-ab39-49fd-ab46-448f90463c8a req-b361fcf2-fc78-4a10-a90a-b3e35c8e253e service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-7c569837-ab39-49fd-ab46-448f90463c8a req-b361fcf2-fc78-4a10-a90a-b3e35c8e253e service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:42 user nova-compute[76049]: DEBUG nova.compute.manager [req-7c569837-ab39-49fd-ab46-448f90463c8a req-b361fcf2-fc78-4a10-a90a-b3e35c8e253e service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] No waiting events found dispatching network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:02:42 user nova-compute[76049]: WARNING nova.compute.manager [req-7c569837-ab39-49fd-ab46-448f90463c8a req-b361fcf2-fc78-4a10-a90a-b3e35c8e253e service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received unexpected event network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 for instance with vm_state building and task_state spawning.
Nov 15 12:02:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f591ada4-7582-46f2-b516-23121cedcef1 req-9fe43422-6389-4031-ad23-d146cf8fcb98 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f591ada4-7582-46f2-b516-23121cedcef1 req-9fe43422-6389-4031-ad23-d146cf8fcb98 service nova] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f591ada4-7582-46f2-b516-23121cedcef1 req-9fe43422-6389-4031-ad23-d146cf8fcb98 service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-f591ada4-7582-46f2-b516-23121cedcef1 req-9fe43422-6389-4031-ad23-d146cf8fcb98 service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.compute.manager [req-f591ada4-7582-46f2-b516-23121cedcef1 req-9fe43422-6389-4031-ad23-d146cf8fcb98 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] No waiting events found dispatching network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:02:44 user nova-compute[76049]: WARNING nova.compute.manager [req-f591ada4-7582-46f2-b516-23121cedcef1 req-9fe43422-6389-4031-ad23-d146cf8fcb98 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received unexpected event network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 for instance with vm_state building and task_state spawning.
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Instance event wait completed in 0 seconds for  {{(pid=76049) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Guest created on hypervisor {{(pid=76049) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:02:44 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Instance spawned successfully.
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Found default for hw_cdrom_bus of ide {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Found default for hw_disk_bus of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Found default for hw_input_bus of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Found default for hw_pointer_model of None {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Found default for hw_video_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Found default for hw_vif_model of virtio {{(pid=76049) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:02:44 user nova-compute[76049]: INFO nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 15 12:02:44 user nova-compute[76049]: DEBUG nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Checking state {{(pid=76049) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:02:44 user nova-compute[76049]: INFO nova.compute.manager [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Took 6.36 seconds to build instance.
Nov 15 12:02:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-4e0bcb97-f665-409a-b0b3-4b25fd2b97ce tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.518s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:02:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:02:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:00 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:03:02 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:03:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:03:02 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:03:02 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:03:02 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:03:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:03:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:03:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:03:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:05 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:08 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:10 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:03:13 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:03:18 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:03:19 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:03:19 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:03:19 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.11206817626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c9945de1-42a3-418f-8641-c0fc3ec29d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:03:19 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:03:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:03:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:03:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:03:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:03:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:03:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:03:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:03:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:03:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:03:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:03:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:03:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:04:03 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:04:03 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:04:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:04:03 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:04:03 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:04:03 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:04:04 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:04:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:04:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:04:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:04:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:12 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:04:14 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:14 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:14 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:20 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:04:21 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:04:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9025MB free_disk=25.11144256591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c9945de1-42a3-418f-8641-c0fc3ec29d60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:04:21 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:04:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-changed-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:04:29 user nova-compute[76049]: DEBUG nova.compute.manager [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Refreshing instance network info cache due to event network-changed-0e142fb4-2a23-4ee1-ab03-988afb5e5336. {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:04:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:04:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:04:29 user nova-compute[76049]: DEBUG nova.network.neutron [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Refreshing network info cache for port 0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:04:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated VIF entry in instance network info cache for port 0e142fb4-2a23-4ee1-ab03-988afb5e5336. {{(pid=76049) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:04:30 user nova-compute[76049]: DEBUG nova.network.neutron [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:04:30 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-8a3f2003-331b-40cc-b8b4-96d3363e0521 req-be78404a-0684-4ca8-8126-26b6b6aa1151 service nova] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:04:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:04:33 user nova-compute[76049]: INFO nova.compute.manager [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attaching volume 7fcaced6-b358-4e9d-aad3-7fd05f55936e to /dev/vdb
Nov 15 12:04:33 user nova-compute[76049]: DEBUG os_brick.utils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf38f35-a31e-4935-8702-4dbc518474ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ccfc78-1792-4682-9e7d-f9ead37ad328]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b24a22-ff51-4c02-b0e9-5f92f0fec29d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97483af-1ea9-4561-9df0-946f375f4ec6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:04:33 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:04:33 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4c90a-6a8e-4a8b-8050-377ff9f92d1b]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG os_brick.utils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating existing volume attachment record: 63c657d4-1426-41a5-96a8-83bd7211ff05 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:04:33 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhWQRGHV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:04:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:04:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:04:38 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfd3785-8727-48e8-9536-c18d4f03aaa8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:04:38 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e33cee-01af-466b-a725-9dfdbb7e21b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e] added
Nov 15 12:04:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be36e43-a67c-46f5-b37e-0304bef8bb34]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[25904ef3-d274-48e2-864f-40bce015101f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhWQRGHV {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhWQRGHV" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa4018-5925-4905-818f-e2968070a283]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EhWQRGHV'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f178c-737b-480e-b6a8-c4e641d1ad66]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d33b4f-7c06-440c-9709-f1c99631c41b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:04:38 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:04:38 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:04:38 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 12:04:38 user nova-compute[76049]: 
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc60de97-1a9c-4758-880b-308992cc09f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260]
Nov 15 12:04:38 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260] successful.
Nov 15 12:04:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755548d-f714-4ae8-b02c-f1f7bc91b294]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdaaa72-7aee-43cb-af75-ad11860c8c3c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e (non-flash)
Nov 15 12:04:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e (non-flash)
Nov 15 12:04:38 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac61d94-6b66-4817-a99d-df00f781dcac]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhWQRGHV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:04:38 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23864383566383436', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864383566383436', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG nova.objects.instance [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:04:39 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:04:39 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:04:39 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:04:39 user nova-compute[76049]:   <serial>7fcaced6-b358-4e9d-aad3-7fd05f55936e</serial>
Nov 15 12:04:39 user nova-compute[76049]: </disk>
Nov 15 12:04:39 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No VIF found with MAC fa:16:3e:9e:f0:30, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:04:39 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-0e01dda7-6927-4f82-91b5-b8e0af201bec tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.377s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:04:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:04:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:04:50 user nova-compute[76049]: INFO nova.compute.manager [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Detaching volume 7fcaced6-b358-4e9d-aad3-7fd05f55936e
Nov 15 12:04:50 user nova-compute[76049]: INFO nova.virt.block_device [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attempting to driver detach volume 7fcaced6-b358-4e9d-aad3-7fd05f55936e from mountpoint /dev/vdb
Nov 15 12:04:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Attempting to detach device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:04:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:04:50 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:04:50 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:04:50 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:04:50 user nova-compute[76049]:   <serial>7fcaced6-b358-4e9d-aad3-7fd05f55936e</serial>
Nov 15 12:04:50 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:04:50 user nova-compute[76049]: </disk>
Nov 15 12:04:50 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:04:50 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config.
Nov 15 12:04:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:04:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:04:50 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:04:50 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:04:50 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:04:50 user nova-compute[76049]:   <serial>7fcaced6-b358-4e9d-aad3-7fd05f55936e</serial>
Nov 15 12:04:50 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:04:50 user nova-compute[76049]: </disk>
Nov 15 12:04:50 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:04:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:04:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:04:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:02 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:03 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:05:04 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:05:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:05:04 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:05:04 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:05:04 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:05:05 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:05:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:05:05 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:05:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:10 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 is timed out.
Nov 15 12:05:10 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config.
Nov 15 12:05:10 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhWQRGHV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:05:10 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cad77d-b33d-4fa0-9512-7b03591a1b55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:05:10 user nova-compute[76049]: No targets found.
Nov 15 12:05:10 user nova-compute[76049]: iSNS:
Nov 15 12:05:10 user nova-compute[76049]: No targets found.
Nov 15 12:05:10 user nova-compute[76049]: STATIC:
Nov 15 12:05:10 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e
Nov 15 12:05:10 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:05:10 user nova-compute[76049]:                 Iface Name: default
Nov 15 12:05:10 user nova-compute[76049]: FIRMWARE:
Nov 15 12:05:10 user nova-compute[76049]: No targets found.
Nov 15 12:05:10 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:05:10 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:05:10 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d3a0c5-7430-4e6d-9dfc-ad428a08d9a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ee430-9869-4cac-8456-34fffb655e66]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e (non-flash)
Nov 15 12:05:10 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e (non-flash)
Nov 15 12:05:10 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62607af1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd06e6dc-4c34-4ade-b7fe-20f10e727926]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[71374f96-b208-4f07-b623-16d7dc4ddd37]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1a73e1-9d1a-4d2e-9e74-0a21a12c1170]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446cef0-2ab8-4975-9fa1-858c4ab4bb86]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[329105b6-855e-447b-91eb-f7d92477e3f4]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a547f-b71b-4d08-ad8c-990bd3cffa19]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260]
Nov 15 12:05:10 user nova-compute[76049]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e, portal: 172.16.0.220,3260] successful.
Nov 15 12:05:10 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:10 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcaced6-b358-4e9d-aad3-7fd05f55936e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[df360745-e5e5-4b37-9262-afd601e352cb]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== disconnect_volume: return (291ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG nova.objects.instance [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:05:11 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-c77dd424-19cd-404c-ac8e-d73fa68397e2 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.599s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:05:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:13 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:05:14 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:05:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:05:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:05:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:22 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:23 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:05:23 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:05:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.110164642333984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c9945de1-42a3-418f-8641-c0fc3ec29d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:05:23 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:05:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.143s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:05:42 user nova-compute[76049]: INFO nova.compute.manager [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attaching volume b2e39dfc-d351-4796-bf9f-f5346ad97503 to /dev/vdb
Nov 15 12:05:42 user nova-compute[76049]: DEBUG os_brick.utils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf10fe40-a552-41c7-ada2-545997e5c622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[534a3626-e955-42f5-8dd9-51d0de789b4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[025f51b4-154d-485f-a8ba-109d0d883f8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fb37c3-9030-4340-b822-fd8ddb231660]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:05:42 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:05:42 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8347123-f511-4be9-b481-5503134d0fac]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG os_brick.utils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:05:42 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating existing volume attachment record: ad0bc51f-6e8b-4c26-b3a5-dc10160b7412 {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:05:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNmbkOhF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:05:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:05:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:05:47 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a165cc-05c6-44c9-a09e-0e2e8695c1df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:05:47 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b55b50-1411-4481-98c3-4bdf34c7e898]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503] added
Nov 15 12:05:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d6a3c8-f261-4031-9ed7-58f7fc4ed659]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae540d9-bb0e-4674-97b6-11edaf41668f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNmbkOhF {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNmbkOhF" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1f708e-6484-4645-8f69-0fba35dd0ddf]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNmbkOhF'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d3ea10-c376-4e6b-bab8-851398c6f38f]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4262e-0cf7-4d2d-bc19-a8bfecc753f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:05:47 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:05:47 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:05:47 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 12:05:47 user nova-compute[76049]: 
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be781f0-aed3-4e46-81fc-f13cb5af728e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260]
Nov 15 12:05:47 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260] successful.
Nov 15 12:05:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[52965004-a794-442b-9d4a-a71aa0230b21]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1604a4-058b-422c-ab5f-41876bdb00a5]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 (non-flash)
Nov 15 12:05:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 (non-flash)
Nov 15 12:05:47 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f173c-c48c-4e57-872d-2f4364356120]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:05:47 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNmbkOhF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:05:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:05:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23963323035313963', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:05:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963323035313963', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:05:48 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:05:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:05:48 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:05:48 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:05:48 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:05:48 user nova-compute[76049]:   <serial>b2e39dfc-d351-4796-bf9f-f5346ad97503</serial>
Nov 15 12:05:48 user nova-compute[76049]: </disk>
Nov 15 12:05:48 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:05:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:05:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:05:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No VIF found with MAC fa:16:3e:9e:f0:30, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:05:49 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1034ad6c-e725-41a4-844e-31055022ddbd tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.545s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:05:51 user nova-compute[76049]: INFO nova.compute.manager [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Detaching volume b2e39dfc-d351-4796-bf9f-f5346ad97503
Nov 15 12:05:51 user nova-compute[76049]: INFO nova.virt.block_device [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attempting to driver detach volume b2e39dfc-d351-4796-bf9f-f5346ad97503 from mountpoint /dev/vdb
Nov 15 12:05:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Attempting to detach device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:05:51 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:05:51 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:05:51 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:05:51 user nova-compute[76049]:   <serial>b2e39dfc-d351-4796-bf9f-f5346ad97503</serial>
Nov 15 12:05:51 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:05:51 user nova-compute[76049]: </disk>
Nov 15 12:05:51 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:05:51 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config.
Nov 15 12:05:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:05:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:05:51 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:05:51 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:05:51 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:05:51 user nova-compute[76049]:   <serial>b2e39dfc-d351-4796-bf9f-f5346ad97503</serial>
Nov 15 12:05:51 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:05:51 user nova-compute[76049]: </disk>
Nov 15 12:05:51 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:05:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:05:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:05:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:06:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:06:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:06:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:05 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:05 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:06:05 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:06:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:06:05 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:06:05 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:06:05 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:06:06 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:06:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:06:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:06:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:12 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 is timed out.
Nov 15 12:06:12 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config.
Nov 15 12:06:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNmbkOhF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:06:12 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d0df03-3f8b-4680-9ab8-2730818aed78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:06:12 user nova-compute[76049]: No targets found.
Nov 15 12:06:12 user nova-compute[76049]: iSNS:
Nov 15 12:06:12 user nova-compute[76049]: No targets found.
Nov 15 12:06:12 user nova-compute[76049]: STATIC:
Nov 15 12:06:12 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503
Nov 15 12:06:12 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:06:12 user nova-compute[76049]:                 Iface Name: default
Nov 15 12:06:12 user nova-compute[76049]: FIRMWARE:
Nov 15 12:06:12 user nova-compute[76049]: No targets found.
Nov 15 12:06:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:06:12 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:06:12 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2708c0-b788-4371-bbce-223c6ad9a9e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b57a745-c018-4a78-8ec6-b6170d2365d8]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 (non-flash)
Nov 15 12:06:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 (non-flash)
Nov 15 12:06:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f628440f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe2860-41e4-4e94-9fff-9fc00cfb70d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5074d49d-3744-4771-bbf6-9490ff37de25]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7b50f-9345-4d6f-add7-ccd9008ca162]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c5397-b9c8-4532-92b3-b1f773d0a2b5]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd8bef0-ce54-4c1a-989a-08b6d66c21a6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[795bab2a-8dfd-495d-b3d7-2114c24c8068]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260]
Nov 15 12:06:12 user nova-compute[76049]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503, portal: 172.16.0.220,3260] successful.
Nov 15 12:06:12 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e39dfc-d351-4796-bf9f-f5346ad97503 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c467ec-a5b0-4c3c-9d9f-0743ad9a3d38]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== disconnect_volume: return (309ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:06:12 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:06:13 user nova-compute[76049]: DEBUG nova.objects.instance [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:06:13 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-1b17c20d-4799-44e3-a5ee-d0c77ae86608 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.593s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:06:14 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:14 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:06:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 12:06:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] There are 0 instances to clean {{(pid=76049) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 12:06:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:06:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.109195709228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c9945de1-42a3-418f-8641-c0fc3ec29d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing inventories for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating ProviderTree inventory for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Updating inventory in ProviderTree for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing aggregate associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, aggregates: None {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Refreshing trait associations for resource provider 260aaae9-3cc3-45eb-be88-21bcfcddde10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=76049) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:06:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:06:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:36 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:36 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Cleaning up deleted instances with incomplete migration  {{(pid=76049) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 12:06:39 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:06:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:06:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:06:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:06:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:43 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:06:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:06:43 user nova-compute[76049]: DEBUG nova.objects.instance [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:06:43 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:06:44 user nova-compute[76049]: INFO nova.compute.manager [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attaching volume ce8bce39-9b11-4c2d-8609-c80c31148caf to /dev/vdb
Nov 15 12:06:44 user nova-compute[76049]: DEBUG os_brick.utils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4971497c-88c7-4603-a441-10991fedad3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c07d144-0294-4d1f-8710-de5f5b3cc6a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d114fde-865b-4b2c-bd8d-4c4b44bb2c91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd072522-850a-48e1-9784-6ab3392490b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:06:44 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:06:44 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5f250d-e4a9-4575-85a9-c0bd552f90a2]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG os_brick.utils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:06:44 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating existing volume attachment record: 379d5db2-46ed-4b31-aea3-b5f8216045ee {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:06:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mESbvUIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:06:48 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:06:48 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:06:48 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8a6f5a-f183-42db-80ab-9cb3d42fb5a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:06:48 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3aa850-d8f8-47d3-9518-dddd894e2c50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf] added
Nov 15 12:06:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[400c51d0-ee4d-4f03-90a0-07986761ae02]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de558e-4f33-4438-be66-a03e6bf81472]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mESbvUIL {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mESbvUIL" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c837d53-d468-4288-b715-b14baaad2fc6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mESbvUIL'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2d6e4-2c08-4773-988c-36c6b946eb43]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07c5ab9-0273-46e5-a8e7-40859fab14ef]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:06:48 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:06:48 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:06:48 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 12:06:48 user nova-compute[76049]: 
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b988326-63ba-4eea-a78b-a831eee3b225]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260]
Nov 15 12:06:48 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260] successful.
Nov 15 12:06:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff9af92-0b49-4b00-abfd-b437a2cd7ef9]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3abe268-085a-45c4-ad2b-7bbbacf08bf1]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf (non-flash)
Nov 15 12:06:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf (non-flash)
Nov 15 12:06:48 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b7cff-b8ab-4d33-b04a-3b6825bfd508]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:06:48 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:06:49 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:06:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mESbvUIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:06:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:06:49 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26236343965313037', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:06:49 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236343965313037', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:06:50 user nova-compute[76049]: DEBUG nova.objects.instance [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:06:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:06:50 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:06:50 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:06:50 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:06:50 user nova-compute[76049]:   <serial>ce8bce39-9b11-4c2d-8609-c80c31148caf</serial>
Nov 15 12:06:50 user nova-compute[76049]: </disk>
Nov 15 12:06:50 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:06:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:06:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:06:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No VIF found with MAC fa:16:3e:9e:f0:30, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:06:50 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-315c54a7-2ded-41af-af99-535fad58b81c tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.556s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:06:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:52 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:06:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:06:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:06:53 user nova-compute[76049]: INFO nova.compute.manager [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Detaching volume ce8bce39-9b11-4c2d-8609-c80c31148caf
Nov 15 12:06:53 user nova-compute[76049]: INFO nova.virt.block_device [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attempting to driver detach volume ce8bce39-9b11-4c2d-8609-c80c31148caf from mountpoint /dev/vdb
Nov 15 12:06:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Attempting to detach device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:06:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:06:53 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:06:53 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:06:53 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:06:53 user nova-compute[76049]:   <serial>ce8bce39-9b11-4c2d-8609-c80c31148caf</serial>
Nov 15 12:06:53 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:06:53 user nova-compute[76049]: </disk>
Nov 15 12:06:53 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:06:53 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config.
Nov 15 12:06:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:06:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:06:53 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:06:53 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:06:53 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:06:53 user nova-compute[76049]:   <serial>ce8bce39-9b11-4c2d-8609-c80c31148caf</serial>
Nov 15 12:06:53 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:06:53 user nova-compute[76049]: </disk>
Nov 15 12:06:53 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:06:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:06:53 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:06:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:04 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:07:06 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:07:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:07:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:07:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:13 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 is timed out.
Nov 15 12:07:13 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config.
Nov 15 12:07:13 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mESbvUIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:07:13 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f40dd5a-e7ea-442f-9cb1-1b1f6617e9ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:07:13 user nova-compute[76049]: No targets found.
Nov 15 12:07:13 user nova-compute[76049]: iSNS:
Nov 15 12:07:13 user nova-compute[76049]: No targets found.
Nov 15 12:07:13 user nova-compute[76049]: STATIC:
Nov 15 12:07:13 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf
Nov 15 12:07:13 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:07:13 user nova-compute[76049]:                 Iface Name: default
Nov 15 12:07:13 user nova-compute[76049]: FIRMWARE:
Nov 15 12:07:13 user nova-compute[76049]: No targets found.
Nov 15 12:07:13 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:07:13 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:07:13 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb85bdb-4040-4e1b-b2e4-93cf3b866b1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[11deea54-079e-4584-a448-a7cc7f97e12a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf (non-flash)
Nov 15 12:07:13 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf (non-flash)
Nov 15 12:07:13 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6284611900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c318fac-63c1-4a51-ad91-0910432861cb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa6172-d61c-4ef9-bd9a-e2299d685472]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba838d-8f94-4121-922e-3dccce3ce77a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c61253-2fad-4c20-ae6a-ba959afec51a]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:07:13 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aab08e-107f-48e2-a6f8-82939a5e9db7]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53326a0-9e56-4413-89eb-c2edefc464f4]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260]
Nov 15 12:07:14 user nova-compute[76049]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf, portal: 172.16.0.220,3260] successful.
Nov 15 12:07:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bce39-9b11-4c2d-8609-c80c31148caf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b3bd2a-502d-492c-8ff3-2cdab71da1e6]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== disconnect_volume: return (288ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:07:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:07:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:07:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-93b29446-225f-4234-af52-680e6fe4e770 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:07:15 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:16 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:07:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:20 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:24 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:07:25 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:07:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.108200073242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c9945de1-42a3-418f-8641-c0fc3ec29d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:07:25 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:07:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:26 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_power_states {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:07:26 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Triggering sync for uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 12:07:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:07:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:07:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:07:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:07:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:07:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:07:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:07:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:07:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:07:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG nova.objects.instance [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:07:45 user nova-compute[76049]: INFO nova.compute.manager [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attaching volume d2cd526a-ddca-40ec-998d-5214d060cbf7 to /dev/vdb
Nov 15 12:07:45 user nova-compute[76049]: DEBUG os_brick.utils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[3578ebc4-a136-4b60-945b-c5746b1c6dea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af9c76f6724e\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[88926cc3-aff9-438f-859c-4aab897610ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5435fe95-18a7-4530-9c22-3e566342ed7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98bf973-782c-48f7-b80e-6ed7c7d7c6b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:45 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Running cmd (subprocess): nvme version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] 'nvme version' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] nvme not present on system {{(pid=76049) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:07:46 user nova-compute[76049]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:07:46 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9bcf33-9487-41bd-b4f8-2a896c82d227]: (4, '') {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76049) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.lightos [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] LIGHTOS: no hostnqn found. {{(pid=76049) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG os_brick.utils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af9c76f6724e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG nova.virt.block_device [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating existing volume attachment record: ce9126dc-fa30-41eb-8d4a-601ced91446a {{(pid=76049) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:07:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:07:48 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Calling os-brick to attach iSCSI Volume {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWcAKhyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:07:50 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:07:50 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:07:50 user nova-compute[76049]: INFO os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6546ea-696b-4d7a-aa45-8d12cb10ee1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:07:50 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53ea86-4a43-46d2-bca3-fb36d657e9eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7] added\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7] added
Nov 15 12:07:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d559391-7c60-46ed-bc75-fa45fdd8596a]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a6c47-b53f-4d81-9987-fcbb8b09e59b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWcAKhyt {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWcAKhyt" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[d907d75b-45b6-4ea4-9dc7-70b7ee2ee3a2]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qWcAKhyt'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[866a8a51-3a1a-48ce-a96b-1a258e68327c]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe394a-1c31-48bf-9ab8-0468dfe9fed7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:07:50 user nova-compute[76049]:  {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:07:50 user nova-compute[76049]:  {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:07:50 user nova-compute[76049]: WARNING os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 12:07:50 user nova-compute[76049]: 
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --login {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d2273-bc73-4dce-b68c-6e782d6b1e09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260]
Nov 15 12:07:50 user nova-compute[76049]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260] successful.
Nov 15 12:07:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[242e1db5-0663-44e9-8d54-76b434bfbd40]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce70314-3d59-4eae-b065-316bb0b03645]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 (non-flash)
Nov 15 12:07:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 (non-flash)
Nov 15 12:07:50 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to 172.16.0.220:3260 {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=76049) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76049) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd188372-5896-46b0-8d36-c227652f6dd1]: (4, ('- - 0', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76049) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:07:50 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWcAKhyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76049) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:07:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:07:51 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23537363139353765', 'path': '/dev/sdb'} {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:07:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537363139353765', 'path': '/dev/sdb'} {{(pid=76049) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:07:51 user nova-compute[76049]: DEBUG nova.objects.instance [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:07:51 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:07:51 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:07:51 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:07:51 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:07:51 user nova-compute[76049]:   <serial>d2cd526a-ddca-40ec-998d-5214d060cbf7</serial>
Nov 15 12:07:51 user nova-compute[76049]: </disk>
Nov 15 12:07:51 user nova-compute[76049]:  {{(pid=76049) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:07:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vda, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:07:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76049) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:07:52 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] No VIF found with MAC fa:16:3e:9e:f0:30, not building metadata {{(pid=76049) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:07:52 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-06768616-0a15-49ee-96de-319735def5df tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.314s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:07:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:07:53 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:07:53 user nova-compute[76049]: INFO nova.compute.manager [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Detaching volume d2cd526a-ddca-40ec-998d-5214d060cbf7
Nov 15 12:07:54 user nova-compute[76049]: INFO nova.virt.block_device [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Attempting to driver detach volume d2cd526a-ddca-40ec-998d-5214d060cbf7 from mountpoint /dev/vdb
Nov 15 12:07:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Attempting to detach device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config. {{(pid=76049) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:07:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:07:54 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:07:54 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:07:54 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:07:54 user nova-compute[76049]:   <serial>d2cd526a-ddca-40ec-998d-5214d060cbf7</serial>
Nov 15 12:07:54 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:07:54 user nova-compute[76049]: </disk>
Nov 15 12:07:54 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:07:54 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the persistent domain config.
Nov 15 12:07:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config. {{(pid=76049) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:07:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.guest [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:07:54 user nova-compute[76049]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:07:54 user nova-compute[76049]:   <source dev="/dev/sdb"/>
Nov 15 12:07:54 user nova-compute[76049]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:07:54 user nova-compute[76049]:   <serial>d2cd526a-ddca-40ec-998d-5214d060cbf7</serial>
Nov 15 12:07:54 user nova-compute[76049]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:07:54 user nova-compute[76049]: </disk>
Nov 15 12:07:54 user nova-compute[76049]:  {{(pid=76049) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:07:54 user nova-compute[76049]: DEBUG nova.virt.libvirt.driver [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:07:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:07:58 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:01 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:08:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:06 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:08:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:08:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:08:07 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquired lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:08:07 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Forcefully refreshing network info cache for instance {{(pid=76049) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:08:07 user nova-compute[76049]: DEBUG nova.objects.instance [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lazy-loading 'info_cache' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:08:08 user nova-compute[76049]: DEBUG nova.network.neutron [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [{"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:08:08 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Releasing lock "refresh_cache-c9945de1-42a3-418f-8641-c0fc3ec29d60" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:08:08 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updated the network info_cache for instance {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:08:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:11 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:14 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 is timed out.
Nov 15 12:08:14 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully detached device vdb from instance c9945de1-42a3-418f-8641-c0fc3ec29d60 from the live domain config.
Nov 15 12:08:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] calling os-brick to detach iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62846fe8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWcAKhyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:08:14 user nova-compute[76049]: WARNING os_brick.initiator.connectors.base [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13b16c-de5b-4b2c-afc1-4bd20d71971d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:08:14 user nova-compute[76049]: No targets found.
Nov 15 12:08:14 user nova-compute[76049]: iSNS:
Nov 15 12:08:14 user nova-compute[76049]: No targets found.
Nov 15 12:08:14 user nova-compute[76049]: STATIC:
Nov 15 12:08:14 user nova-compute[76049]: Target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7
Nov 15 12:08:14 user nova-compute[76049]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:08:14 user nova-compute[76049]:                 Iface Name: default
Nov 15 12:08:14 user nova-compute[76049]: FIRMWARE:
Nov 15 12:08:14 user nova-compute[76049]: No targets found.
Nov 15 12:08:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:08:14 user nova-compute[76049]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:08:14 user nova-compute[76049]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76049) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7', 0)] {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5007a75-d3fd-407a-90d0-c6ae6ed9c9d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[0968e168-6eb1-405a-bb2f-0c3fc6798353]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 (non-flash)\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 (non-flash)
Nov 15 12:08:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 (non-flash)
Nov 15 12:08:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f626075a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7'): ({'sdb'}, set())}) {{(pid=76049) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Removing single pathed devices sdb {{(pid=76049) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d99f9b-709a-4705-b28d-bac0fc7d62e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e69ac-5e7b-4d14-841d-d8c6b8aa7831]: (4, ('ok\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Flushing IO for device /dev/sdb {{(pid=76049) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[019f1d12-ae15-4823-889f-f32ec9e853c0]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76049) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3eeac2-8cf9-4078-9df8-e0eeb70a3b95]: (4, ('1', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.linuxscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] SCSI volumes sdb have been removed. {{(pid=76049) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7')] {{(pid=76049) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc74f3c-baac-4589-89f9-60e93ff4487b]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --logout {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179b5f3-4bea-406d-a771-faa2c1586a43]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260]
Nov 15 12:08:14 user nova-compute[76049]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7, portal: 172.16.0.220,3260] successful.
Nov 15 12:08:14 user nova-compute[76049]:  stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op delete {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd526a-ddca-40ec-998d-5214d060cbf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7128c-37e2-477c-879e-fed1b787f6a5]: (4, ('', '')) {{(pid=85916) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76049) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.base [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] <== disconnect_volume: return (298ms) None {{(pid=76049) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:08:14 user nova-compute[76049]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Disconnected iSCSI Volume {{(pid=76049) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:08:15 user nova-compute[76049]: DEBUG nova.objects.instance [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'flavor' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:08:15 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-bb5db968-874f-4a7f-b85f-715982196e63 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.596s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:16 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:16 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:08:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:08:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:21 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:08:26 user nova-compute[76049]: DEBUG oslo_concurrency.processutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:08:27 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:08:27 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:08:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=8990MB free_disk=25.107242584228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Instance c9945de1-42a3-418f-8641-c0fc3ec29d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76049) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:08:27 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:31 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:36 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:37 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:08:41 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:46 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:08:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:51 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:56 user nova-compute[76049]: INFO nova.compute.manager [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Terminating instance
Nov 15 12:08:56 user nova-compute[76049]: DEBUG nova.compute.manager [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Start destroying the instance on the hypervisor. {{(pid=76049) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:56 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3d74fa6-59b0-4878-8851-2de15ba982af req-c4ce0e72-c83c-46f9-a443-840caadb7106 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-vif-unplugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3d74fa6-59b0-4878-8851-2de15ba982af req-c4ce0e72-c83c-46f9-a443-840caadb7106 service nova] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3d74fa6-59b0-4878-8851-2de15ba982af req-c4ce0e72-c83c-46f9-a443-840caadb7106 service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-b3d74fa6-59b0-4878-8851-2de15ba982af req-c4ce0e72-c83c-46f9-a443-840caadb7106 service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3d74fa6-59b0-4878-8851-2de15ba982af req-c4ce0e72-c83c-46f9-a443-840caadb7106 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] No waiting events found dispatching network-vif-unplugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.compute.manager [req-b3d74fa6-59b0-4878-8851-2de15ba982af req-c4ce0e72-c83c-46f9-a443-840caadb7106 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-vif-unplugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 for instance with task_state deleting. {{(pid=76049) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [-] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Instance destroyed successfully.
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.objects.instance [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lazy-loading 'resources' on Instance uuid c9945de1-42a3-418f-8641-c0fc3ec29d60 {{(pid=76049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.virt.libvirt.vif [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1492800346',display_name='tempest-SnapshotDataIntegrityTests-server-1492800346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1492800346',id=53,image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9VDSuYtSiSr10ovxAnGLKZpszlIe68JiQunUk6qzxk5RuAPwje3q+xc5ViO152kzLGusOMWE5hUdi5ciX5f9xPFgikKHhAQzyOeucM8RQ3H+6yVWrpl6WEg1LwHEebdw==',key_name='tempest-keypair-2023013062',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78c3ccb20e3e4b45b152ef41ba57081d',ramdisk_id='',reservation_id='r-8rn4zgjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b3c94d7-0d98-4e44-a0fb-491b41156c7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1875141519',owner_user_name='tempest-SnapshotDataIntegrityTests-1875141519-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c79aa3da66e4d539a58210aac582212',uuid=c9945de1-42a3-418f-8641-c0fc3ec29d60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Converting VIF {"id": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "address": "fa:16:3e:9e:f0:30", "network": {"id": "a50b18e0-c332-45f6-8491-3cc64e6cbfa6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1096988643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78c3ccb20e3e4b45b152ef41ba57081d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e142fb4-2a", "ovs_interfaceid": "0e142fb4-2a23-4ee1-ab03-988afb5e5336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.network.os_vif_util [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f0:30,bridge_name='br-int',has_traffic_filtering=True,id=0e142fb4-2a23-4ee1-ab03-988afb5e5336,network=Network(a50b18e0-c332-45f6-8491-3cc64e6cbfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e142fb4-2a') {{(pid=76049) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG os_vif [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f0:30,bridge_name='br-int',has_traffic_filtering=True,id=0e142fb4-2a23-4ee1-ab03-988afb5e5336,network=Network(a50b18e0-c332-45f6-8491-3cc64e6cbfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e142fb4-2a') {{(pid=76049) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e142fb4-2a, bridge=br-int, if_exists=True) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f067001-7fb9-4454-a69c-38b8d9e2aff6) {{(pid=76049) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:08:57 user nova-compute[76049]: INFO os_vif [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f0:30,bridge_name='br-int',has_traffic_filtering=True,id=0e142fb4-2a23-4ee1-ab03-988afb5e5336,network=Network(a50b18e0-c332-45f6-8491-3cc64e6cbfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e142fb4-2a')
Nov 15 12:08:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Deleting instance files /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60_del
Nov 15 12:08:57 user nova-compute[76049]: INFO nova.virt.libvirt.driver [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Deletion of /opt/stack/data/nova/instances/c9945de1-42a3-418f-8641-c0fc3ec29d60_del complete
Nov 15 12:08:57 user nova-compute[76049]: INFO nova.compute.manager [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 12:08:57 user nova-compute[76049]: DEBUG oslo.service.loopingcall [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76049) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.compute.manager [-] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Deallocating network for instance {{(pid=76049) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:08:57 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] deallocate_for_instance() {{(pid=76049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:08:58 user nova-compute[76049]: DEBUG nova.network.neutron [-] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Updating instance_info_cache with network_info: [] {{(pid=76049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:08:58 user nova-compute[76049]: INFO nova.compute.manager [-] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Took 0.83 seconds to deallocate network for instance.
Nov 15 12:08:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:08:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:08:58 user nova-compute[76049]: DEBUG nova.compute.manager [req-489f04d7-dd20-47da-baab-af553b5beed3 req-f727f815-1adc-4d7c-b22f-765155f71743 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-vif-deleted-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:08:58 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:08:58 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:08:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:58 user nova-compute[76049]: INFO nova.scheduler.client.report [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Deleted allocations for instance c9945de1-42a3-418f-8641-c0fc3ec29d60
Nov 15 12:08:58 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-ce518b0a-b3b5-415f-aacb-02d8c48829b4 tempest-SnapshotDataIntegrityTests-1875141519 tempest-SnapshotDataIntegrityTests-1875141519-project-member] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-e766e888-c14e-4ebb-9033-ec3df3da347d req-6ef3a49f-601c-4f65-be72-f1d0e22d2314 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received event network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:08:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e766e888-c14e-4ebb-9033-ec3df3da347d req-6ef3a49f-601c-4f65-be72-f1d0e22d2314 service nova] Acquiring lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:08:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e766e888-c14e-4ebb-9033-ec3df3da347d req-6ef3a49f-601c-4f65-be72-f1d0e22d2314 service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:08:59 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [req-e766e888-c14e-4ebb-9033-ec3df3da347d req-6ef3a49f-601c-4f65-be72-f1d0e22d2314 service nova] Lock "c9945de1-42a3-418f-8641-c0fc3ec29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:08:59 user nova-compute[76049]: DEBUG nova.compute.manager [req-e766e888-c14e-4ebb-9033-ec3df3da347d req-6ef3a49f-601c-4f65-be72-f1d0e22d2314 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] No waiting events found dispatching network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 {{(pid=76049) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:08:59 user nova-compute[76049]: WARNING nova.compute.manager [req-e766e888-c14e-4ebb-9033-ec3df3da347d req-6ef3a49f-601c-4f65-be72-f1d0e22d2314 service nova] [instance: c9945de1-42a3-418f-8641-c0fc3ec29d60] Received unexpected event network-vif-plugged-0e142fb4-2a23-4ee1-ab03-988afb5e5336 for instance with vm_state deleted and task_state None.
Nov 15 12:09:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:06 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:09:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:09:07 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:09:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:11 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:17 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:17 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76049) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:09:17 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:18 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:19 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:21 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:09:22 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:27 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager.update_available_resource {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Auditing locally available compute resources for user (node: user) {{(pid=76049) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:09:28 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:09:28 user nova-compute[76049]: WARNING nova.virt.libvirt.driver [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:09:28 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Hypervisor/Node resource view: name=user free_ram=9152MB free_disk=25.12653350830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76049) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76049) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:09:28 user nova-compute[76049]: DEBUG nova.compute.provider_tree [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed in ProviderTree for provider: 260aaae9-3cc3-45eb-be88-21bcfcddde10 {{(pid=76049) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:09:29 user nova-compute[76049]: DEBUG nova.scheduler.client.report [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Inventory has not changed for provider 260aaae9-3cc3-45eb-be88-21bcfcddde10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76049) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:09:29 user nova-compute[76049]: DEBUG nova.compute.resource_tracker [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Compute_service record updated for user:user {{(pid=76049) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:09:29 user nova-compute[76049]: DEBUG oslo_concurrency.lockutils [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=76049) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:09:32 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:09:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:09:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76049) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:09:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:09:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76049) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:09:37 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:42 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:47 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:50 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:52 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:53 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:09:57 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:10:02 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:10:07 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:10:07 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:10:09 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Starting heal instance info cache {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Rebuilding the list of instances to heal {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:10:09 user nova-compute[76049]: DEBUG nova.compute.manager [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Didn't find any instances for network info cache update. {{(pid=76049) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:10:12 user nova-compute[76049]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76049) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:10:13 user nova-compute[76049]: DEBUG oslo_service.periodic_task [None req-5e71ab98-9da3-40ca-b562-21dec6f5c1ad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}